-- Logs begin at Fri 2022-08-12 10:08:43 UTC, end at Fri 2022-08-12 11:04:41 UTC. -- Aug 12 10:33:16.976755 dv-cinder-852945-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 12 10:33:16.985949 dv-cinder-852945-1-smb devstack@keystone.service[93262]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 10:33:16 2022] *** Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: nodename: dv-cinder-852945-1-smb Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: machine: x86_64 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: clock source: unix Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: pcre jit disabled Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: detected number of CPU cores: 4 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: current working directory: / Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: detected binary path: /usr/bin/uwsgi-core Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: your processes number limit is 47680 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: your memory page size is 4096 bytes Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: detected max file descriptor number: 2048 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: lock engine: pthread robust mutexes Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: thunder lock: enabled Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 12 10:33:16.991919 dv-cinder-852945-1-smb devstack@keystone.service[93262]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 10:33:17.027972 dv-cinder-852945-1-smb devstack@keystone.service[93262]: Python main interpreter initialized at 0x56243fe709c0 Aug 12 10:33:17.027972 dv-cinder-852945-1-smb devstack@keystone.service[93262]: python threads support enabled Aug 12 10:33:17.027972 dv-cinder-852945-1-smb devstack@keystone.service[93262]: your server socket listen backlog is limited to 100 connections Aug 12 10:33:17.027972 dv-cinder-852945-1-smb devstack@keystone.service[93262]: your mercy for graceful operations on workers is 90 seconds Aug 12 10:33:17.028314 dv-cinder-852945-1-smb devstack@keystone.service[93262]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 10:33:17.028417 dv-cinder-852945-1-smb devstack@keystone.service[93262]: *** Operational MODE: preforking *** Aug 12 10:33:17.028687 dv-cinder-852945-1-smb devstack@keystone.service[93262]: *** uWSGI is running in multiple interpreter mode *** Aug 12 10:33:17.028687 dv-cinder-852945-1-smb devstack@keystone.service[93262]: spawned uWSGI master process (pid: 93262) Aug 12 10:33:17.028938 dv-cinder-852945-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 12 10:33:17.029439 dv-cinder-852945-1-smb devstack@keystone.service[93262]: spawned uWSGI worker 1 (pid: 93274, cores: 1) Aug 12 10:33:17.029762 dv-cinder-852945-1-smb devstack@keystone.service[93262]: spawned uWSGI worker 2 (pid: 93275, cores: 1) Aug 12 10:33:17.030569 dv-cinder-852945-1-smb devstack@keystone.service[93262]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 10:33:22.394970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:33:22.394970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: from cryptography.utils import int_from_bytes Aug 12 10:33:22.395858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:33:22.395858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: from cryptography.utils import int_from_bytes Aug 12 10:33:22.396302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:33:22.396302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: from cryptography.utils import int_from_bytes Aug 12 10:33:22.396413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:33:22.396413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: from cryptography.utils import int_from_bytes Aug 12 10:33:22.445259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:33:22.445450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:33:22.445450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:33:22.445600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:33:22.445665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] command line args: [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:33:22.445724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] command line args: [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:33:22.445868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:33:22.445956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:33:22.446016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ================================================================================ {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:33:22.446073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ================================================================================ {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:33:22.446247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] admin_token = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.446337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] admin_token = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.446511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] config_dir = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.446645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] config_dir = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.446645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.446887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.446950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] config_source = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.447013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] config_source = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.447072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] debug = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.447142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] debug = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.447201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.448856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.448856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449539 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_config_append = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_config_append = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_dir = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_dir = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_file = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.449990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_file = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.450787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.451921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.452918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] publish_errors = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] publish_errors = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.453962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] standard_threads = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] standard_threads = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.454980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] use_journal = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] use_journal = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] use_json = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] use_json = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] use_stderr = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] use_stderr = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] use_syslog = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] use_syslog = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:33:22.455933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.456918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.457969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.458981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.459925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.460988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.461099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.461208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.461401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.461575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.461708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.461834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.462097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.462264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.462422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.462556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.462798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.462983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.463116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.463231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.463374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.463493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.463713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.463880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.464895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.465944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.466927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.467928 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.468973 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.469975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.470075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.470205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.470387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.470547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.470730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.470894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.471908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.472238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.472369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.472516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.472718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.472903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.473081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.473081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.473081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.473581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.473765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.473765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.474796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.475137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.475313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.475607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.475769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.475954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.476128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.476128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.476473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.476646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.476828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.477939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.478974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.479979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.480930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.481943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.external = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.482885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.password = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] auth.token = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.483897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.484947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.485960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.external = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.486865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.password = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] auth.token = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.487994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.488876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.489994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.490942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491520 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.491971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.492989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.493883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.494956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.495896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.496163 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.496324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.496429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.496601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.496706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.496955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.497949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.498901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.499828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.500991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.501121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.501224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.501359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.501464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.501805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.501960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.502066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.502162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.502257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.502351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.502512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.502782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.503030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.503132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.503285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.503519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.503753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.503864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.504949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.505914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.506952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.507977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.508892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.509985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.510899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.511088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.511201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.511360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.511602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.511884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.511995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.512165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.512426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.512527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.512756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.512858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.513144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.513397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.513652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.513903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.514913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.515099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.515219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.515623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.515724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.515876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.515979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.516981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.517962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.518213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.518328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.518474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.518610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.518777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.518889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.519980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520781 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.520929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] role.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] role.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.521970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] role.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] role.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.522965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.523922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.524867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.525975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.526101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.526219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.526340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.526537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.526798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.526904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.527993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.528937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.529067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.529183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.529413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.529541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.529677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.529913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.530047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.530177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.530367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.530503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.530655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.530882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.531904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.532881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.533956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.534934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.connection = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.535977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.536918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.connection = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.537872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.538962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93274) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:33:22.539744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.539855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.540044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.540283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.540510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.540752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.540981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:33:22.541145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:33:22.568686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.568915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.569190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.569278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.569453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.569675 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.578904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.579332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.606996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.607141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.607260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.607342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.658393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.658993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.707365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.707560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.708381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.708633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.772480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.772821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.772948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.773954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.796596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.796740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.796879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.796960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.797944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.798026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.808846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.809070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.821448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.821705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.821846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.821982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822448 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.822827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.823041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93274) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 10:33:22.839396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.839600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:33:22.839721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.839790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:33:22.839925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.840114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:33:22.840256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.840394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 10:33:22.840474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.840594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.840709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.840834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.840923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.841110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.841234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.841371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.852422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.852666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.852755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.852946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.853071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.853200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.853297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.853529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.860108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.860477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.863157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.863440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.863564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.863701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.863817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.863948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.864933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.865797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.866029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.866328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.888473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.889173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.889937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.890220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.891005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.891293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.895140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.895422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.895700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.895899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.896184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.896464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.902323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.902573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.903119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.903407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.906670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.906980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.907261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.907516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.907641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.907780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.907879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.908913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.909184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.909450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.924372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.924651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.925386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.925666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.928676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.929709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.931817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.932109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.932884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.933178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.936460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.937565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.939638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.940756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.942737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.943053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.943333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.943620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.943897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.944020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.944183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.944286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.944522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.944804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.945080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.945366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.960107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.960396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.960674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.960927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.961390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.961685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.961954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.962216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.967776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.969117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.969351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.969601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.970706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.970966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.972445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.972727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.973026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.973313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.973585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.973765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.974013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.974314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.974604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.974907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.985646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.985646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.985646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.986462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.986462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.986672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:22.986813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.986813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.986966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.986966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.987138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.987435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.987707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:22.987982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.003100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.004691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.006032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.007779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.009013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.010562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.010708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.012072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.012274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.012420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.012604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.013772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.014067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.014344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.019382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.020992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.021115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.022829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.023971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.024261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.024541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.024817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.025757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.026046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.026328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.026606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.032894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.033272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.033700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.034770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.035063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.035344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.040599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.040881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.041155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.041428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.041678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.041979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.042234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93274) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 10:33:23.042359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.042478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.042573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.042809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.042978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.043885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.044004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.044118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.044231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.044489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.044766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.045048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.045298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.045573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.045830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93274) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 10:33:23.077194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56243fe709c0 pid: 93275 (default app) Aug 12 10:33:23.079087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56243fe709c0 pid: 93274 (default app) Aug 12 10:33:23.080500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25883e8b-9ec0-43f2-895a-0b9cc440308a None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:23.080780 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25883e8b-9ec0-43f2-895a-0b9cc440308a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:23.081048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25883e8b-9ec0-43f2-895a-0b9cc440308a None None] PATH_INFO: `/v3` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:23.085446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Fri Aug 12 10:33:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:30.519695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:30.520603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:30.520991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:30.526001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:30 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:30.533950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:30.534391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:30.534481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:30.603558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: INFO dbcounter [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] Registered counter for database keystone Aug 12 10:33:30.624782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG oslo_db.sqlalchemy.engines [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:33:30.634729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writer thread running {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:33:30.822659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG passlib.handlers.bcrypt [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93275) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 10:33:30.823107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG passlib.handlers.bcrypt [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93275) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 10:33:30.877839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:30.879457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:31.025413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 12 10:33:31.567187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:31.648927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: INFO dbcounter [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] Registered counter for database keystone Aug 12 10:33:31.673752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG oslo_db.sqlalchemy.engines [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:33:31.685449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writer thread running {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:33:31.818241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4a487-e9d5-454c-8df4-0fa409d64fc5 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:31.823558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:31.824184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:31.824460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:31.824734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:31.833824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:31.885822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING keystone.common.rbac_enforcer.enforcer [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 10:33:31.886162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c91f7f-dbcd-4c9a-8b4a-4333ab7e7a43 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:31.896724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Aug 12 10:33:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:33:31.907327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:31.929850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8cfae9-6f0f-4462-b064-c48b3ed1c3f5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:31.936334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:31.937462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:31.937741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:31.938012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] PATH_INFO: `/v3/projects/e3424e260c7f45ca91161a9eb3a1a521` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:31.939714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] RBAC: Authorizing `identity:get_project(project_id=e3424e260c7f45ca91161a9eb3a1a521)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:31.989681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 10:33:31.990029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028c1fe-57e0-45f8-bd18-8603ae2e5fe8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:31.994806 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Aug 12 10:33:31 2022] GET /identity/v3/projects/e3424e260c7f45ca91161a9eb3a1a521 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:33.841292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95422f2-71ab-48fe-877f-b387edecd819 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:33.841873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95422f2-71ab-48fe-877f-b387edecd819 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:33.841873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95422f2-71ab-48fe-877f-b387edecd819 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:33.845939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:33.852709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:33.853461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:33.853746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:33.885957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:33.887577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:33.898883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 10:33:34.161627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95422f2-71ab-48fe-877f-b387edecd819 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:34.182795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95422f2-71ab-48fe-877f-b387edecd819 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:34.189179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcddbfc-c4a2-476c-a68c-47fbb362d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:34.189782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcddbfc-c4a2-476c-a68c-47fbb362d9ac admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:34.190066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcddbfc-c4a2-476c-a68c-47fbb362d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:34.190333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcddbfc-c4a2-476c-a68c-47fbb362d9ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:34.199531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcddbfc-c4a2-476c-a68c-47fbb362d9ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:34.201334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcddbfc-c4a2-476c-a68c-47fbb362d9ac admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:34.211158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Aug 12 10:33:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:33:34.219398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:34.233878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ff3e0-e5c5-4a16-b264-f6cd315561a5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:34.242251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76965faf-c5ae-41b1-8cc0-9d948527f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:34.242922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965faf-c5ae-41b1-8cc0-9d948527f800 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:34.243194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965faf-c5ae-41b1-8cc0-9d948527f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:34.243459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76965faf-c5ae-41b1-8cc0-9d948527f800 admin admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:34.244989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965faf-c5ae-41b1-8cc0-9d948527f800 admin admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:34.246857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76965faf-c5ae-41b1-8cc0-9d948527f800 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:34.248382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Fri Aug 12 10:33:34 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:36.190488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafeb2-bc9d-4ba4-99e1-67a9a022577d None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.191084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafeb2-bc9d-4ba4-99e1-67a9a022577d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.191084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeafeb2-bc9d-4ba4-99e1-67a9a022577d None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.192606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:36.197835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.198259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.198385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.216990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:36.218180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:36.224029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201070-67e5-4876-9425-e2d9b261c098 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.224322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201070-67e5-4876-9425-e2d9b261c098 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.224598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85201070-67e5-4876-9425-e2d9b261c098 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.225909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:33:36.230881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.231160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.231430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.275338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG passlib.handlers.bcrypt [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93274) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 10:33:36.275664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG passlib.handlers.bcrypt [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93274) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 10:33:36.297665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:36.320668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:36.322283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:36.422561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:33:36.564907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:36.589214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:36.668228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bdefb-0016-42cb-8a9f-4472a30d0da3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:36.682974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:36.703528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:36.704187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.704463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.704733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.716587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:36.725572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:36.726499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:33:36.727444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:36.732743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:36.785002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3356-977a-40dc-a0d3-53ef0fcfc364 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:36.787453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:36.811898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:36.823358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:36.824167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.824450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.824726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.830411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538f319-cddc-4f16-a25b-ac11ac761697 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:36.865211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839666-608e-4719-b769-7edac25fe351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:36.865878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839666-608e-4719-b769-7edac25fe351 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:36.866153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839666-608e-4719-b769-7edac25fe351 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:36.866419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07839666-608e-4719-b769-7edac25fe351 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:36.867116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839666-608e-4719-b769-7edac25fe351 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:36.867420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839666-608e-4719-b769-7edac25fe351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:36.868803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07839666-608e-4719-b769-7edac25fe351 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:36.880217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:36.886096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839666-608e-4719-b769-7edac25fe351 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:36.894540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:36.896117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:37.000530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:33:37.006498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:37.009880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:37.096071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07839666-608e-4719-b769-7edac25fe351 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:37.108975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d407c-a027-42af-893a-b43db1638c8a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:37.130487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:37.131151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:37.131410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:37.131683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:37.132812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:37.134274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:37.135849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:36 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:37.141852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:37.142842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:37.143698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:37.143977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:37.144260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:37.156105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:37.163127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:37.164614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:33:37.182519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:37.183447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:33:37.184236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:33:37.184236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:33:37.184236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:37.184236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:37.189494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:37.239280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c428ad1-a939-4fc0-8f5b-a1cac2b6e977 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:37.245153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:37.271644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:37.272515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:37.272792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:37.273061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:37.274178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:37.275686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:37.277240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:37.283030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:37.289208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d790564-50ff-4778-a4c8-232496820bb1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:37.323982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:37.324604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:37.324878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:37.325146 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:37.325788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:37.326085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:37.327492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac9334-5c0c-4c0c-9a61-889897c0fed3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:37.344432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:37.363310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:37.385142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51731c5-5905-49f9-a57b-ec2e081fb639 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:37.423337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:37.423932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:37.424199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:37.424477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:37.425222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.domain.id=default, user.id=27ab679ee4a24103a432644a1ffbc5b2) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:37.425529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:37.427030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db51fc-451b-46b1-a198-c601b4669e7a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:37.434983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Aug 12 10:33:37 2022] GET /identity/v3/role_assignments?user.id=27ab679ee4a24103a432644a1ffbc5b2&scope.domain.id=default&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:39.459791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2bd1c-f0ae-4442-b154-3d8f4ef2de6e None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:39.460796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2bd1c-f0ae-4442-b154-3d8f4ef2de6e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:39.461254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2bd1c-f0ae-4442-b154-3d8f4ef2de6e None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:39.462815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:39.468100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f27ed1-34ad-4ca4-bced-c1d215adb909 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:39.468897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f27ed1-34ad-4ca4-bced-c1d215adb909 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:39.469355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f27ed1-34ad-4ca4-bced-c1d215adb909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:39.495654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-65f27ed1-34ad-4ca4-bced-c1d215adb909 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:39.497177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-65f27ed1-34ad-4ca4-bced-c1d215adb909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:39.580451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:39.804439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8e77-4fdd-4a1f-8bb8-04d718245abc None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:39.804810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8e77-4fdd-4a1f-8bb8-04d718245abc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:39.804999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8e77-4fdd-4a1f-8bb8-04d718245abc None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:39.806309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:39.811791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513759e-5e06-44fa-aabf-e6bde6f800ab None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:39.812083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513759e-5e06-44fa-aabf-e6bde6f800ab None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:39.812362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513759e-5e06-44fa-aabf-e6bde6f800ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:39.839759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e513759e-5e06-44fa-aabf-e6bde6f800ab None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:39.841020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e513759e-5e06-44fa-aabf-e6bde6f800ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:39.923225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:39.963511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465ff9-ff5e-4419-b28a-49cb48dc9bb8 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:39.964129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465ff9-ff5e-4419-b28a-49cb48dc9bb8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:39.964595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465ff9-ff5e-4419-b28a-49cb48dc9bb8 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:39.966137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 13/26] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:39.980012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3aa7d-982c-488f-87d4-7824b81848fc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:39.980304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3aa7d-982c-488f-87d4-7824b81848fc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:39.980586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3aa7d-982c-488f-87d4-7824b81848fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:39.990660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:40.006744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-25d3aa7d-982c-488f-87d4-7824b81848fc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:40.008011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-25d3aa7d-982c-488f-87d4-7824b81848fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:40.082905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92c7d4-c0d4-4077-965b-9f6974996cda None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:40.083097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92c7d4-c0d4-4077-965b-9f6974996cda None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:40.083564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92c7d4-c0d4-4077-965b-9f6974996cda None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:40.087202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:40.093154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92c7d4-c0d4-4077-965b-9f6974996cda None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:40.100106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:40.101700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:40.101986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:40.102259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:40.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:40.146709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:40.272159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:40.335681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92c7d4-c0d4-4077-965b-9f6974996cda None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:40.341941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:40.367161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:40.400815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:40.401458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:40.401786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:40.402061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:40.418332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:40.420133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:40.452304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:40.495956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abad82-28df-474f-b714-124e7cb2bb4c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:40.542042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:40.543082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:40.543605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:40.544063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:40.544939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:40.546530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:33:40.570082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:40.571461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:33:40.572289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:33:40.572289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:33:40.572289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:40.572289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 15/30] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:33:40.572289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:40.704480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 10:33:40 2022] POST /identity/v3/roles => generated 219 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:33:40.705587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:40.739391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234016a4-4991-4b89-a7a1-49c2d7dfcccc None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:40.817246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:40.817899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:40.818173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:40.818495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:40.857009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:40.863647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:40.864492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:40.865275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 16/32] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:33:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:40.865941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:40.886505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef069ed0-ab69-4784-bb42-83dabcfba704 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:40.904848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:40.916180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:40.932804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:40.933442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:40.933724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:40.934001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:40.934666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:40.935015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:40.936567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:40.958012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 17/33] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:40.959402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.017349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e431540-696f-4e91-bb58-de6849e67bff None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.068070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.068070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.068355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.072303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.072303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.072303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.086730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716d0c-ed3d-46c4-9dbe-8385d24370a0 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.122900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.123568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.123892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.124161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.124837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:41.125228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.126513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.136075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 18/34] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:41.136944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.182884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:41.200110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 17/35] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 10:33:40 2022] POST /identity/v3/roles => generated 225 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:33:41.202363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.244066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08d460-8371-408a-823b-cb30df808f8a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.281811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0df00-34e6-4cff-9a45-b9f3bcf92dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.282554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0df00-34e6-4cff-9a45-b9f3bcf92dda None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.282870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0df00-34e6-4cff-9a45-b9f3bcf92dda None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.283144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0df00-34e6-4cff-9a45-b9f3bcf92dda None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.283919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0df00-34e6-4cff-9a45-b9f3bcf92dda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.285442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0df00-34e6-4cff-9a45-b9f3bcf92dda None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.305782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:41.323789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 19/36] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:33:41 2022] POST /identity/v3/projects => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:33:41.328210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19d57f-3942-46e1-b983-f97a8b431cba None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.336386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2cc3-1bad-4ee1-af22-4c77be5ce8dc None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.336797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2cc3-1bad-4ee1-af22-4c77be5ce8dc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.336964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2cc3-1bad-4ee1-af22-4c77be5ce8dc None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.338532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 20/37] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:41.339397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068a0b-f66a-4bad-bb15-70e6913df59c None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.339733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068a0b-f66a-4bad-bb15-70e6913df59c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.340026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64068a0b-f66a-4bad-bb15-70e6913df59c None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.345399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 21/38] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:41.346324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.346614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.347640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.371574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:41.373158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:41.401531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d157f-51dd-4eac-a0e3-56f83d486e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.402734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d157f-51dd-4eac-a0e3-56f83d486e85 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.403216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d157f-51dd-4eac-a0e3-56f83d486e85 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.403766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d157f-51dd-4eac-a0e3-56f83d486e85 None admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.406112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d157f-51dd-4eac-a0e3-56f83d486e85 None admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.408114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d157f-51dd-4eac-a0e3-56f83d486e85 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.410003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 18/39] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:41 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:41.411550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.412042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.412602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.434403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:41.437453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:41.456587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 22/40] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:33:41.457376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.487253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:41.541201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:41.572699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49217b-9607-4bee-93ce-4c28cbd4cab4 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.607123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.607812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.608186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.608466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.609591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.611083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.612824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 23/42] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:41.618426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.705087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:41.720736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9621-1367-40b4-865c-53db7dfc027d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.731507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.756466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.757144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.757430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.757720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] PATH_INFO: `/v3/domains/default/users/27ab679ee4a24103a432644a1ffbc5b2/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.759677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=27ab679ee4a24103a432644a1ffbc5b2, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.761203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.778616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1361 bytes} [Fri Aug 12 10:33:41 2022] PUT /identity/v3/domains/default/users/27ab679ee4a24103a432644a1ffbc5b2/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:33:41.801414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.832844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:41.839368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518556a-914f-4029-bb93-c8d8c58479f6 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.877054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.877712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.878390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.878390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.879455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.881062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.882992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 24/44] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:41.888304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:41.919620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89397f4-5e72-4d21-8493-b14afeec72df None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:41.962116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95614a90-1b1b-4428-9c2e-d0f81f994bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:41.962799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614a90-1b1b-4428-9c2e-d0f81f994bff None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:41.963077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614a90-1b1b-4428-9c2e-d0f81f994bff None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:41.963335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95614a90-1b1b-4428-9c2e-d0f81f994bff None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:41.966046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95614a90-1b1b-4428-9c2e-d0f81f994bff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:41.966046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95614a90-1b1b-4428-9c2e-d0f81f994bff None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:41.984645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 21/45] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 10:33:41 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:33:42.009408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6ceb6-14f3-423e-adfd-0da5e2a94105 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:42.048956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae58e8-2bf9-4ad1-9d26-d0d490894297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:42.049594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae58e8-2bf9-4ad1-9d26-d0d490894297 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:42.049874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae58e8-2bf9-4ad1-9d26-d0d490894297 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:42.050144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae58e8-2bf9-4ad1-9d26-d0d490894297 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:42.050825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae58e8-2bf9-4ad1-9d26-d0d490894297 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:42.052366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae58e8-2bf9-4ad1-9d26-d0d490894297 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:42.083834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 25/46] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:33:41 2022] POST /identity/v3/projects => generated 312 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:33:43.632202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcad92-4fbc-4cb7-ab88-dd625fe8ab63 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:43.632775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcad92-4fbc-4cb7-ab88-dd625fe8ab63 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:43.632775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcad92-4fbc-4cb7-ab88-dd625fe8ab63 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:43.634106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 22/47] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:43.639560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b94a4-a117-4939-8df1-aeb1d0c82b0c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:43.639967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b94a4-a117-4939-8df1-aeb1d0c82b0c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:43.640464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b94a4-a117-4939-8df1-aeb1d0c82b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:43.659110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-656b94a4-a117-4939-8df1-aeb1d0c82b0c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:43.660292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-656b94a4-a117-4939-8df1-aeb1d0c82b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:43.673748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:43.734444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 26/48] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:43.951707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872fd95-6afe-473f-9568-c748b11ec521 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:43.951905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872fd95-6afe-473f-9568-c748b11ec521 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:43.952158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872fd95-6afe-473f-9568-c748b11ec521 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:43.953497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 23/49] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:43.958612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db987ab8-3557-47ae-878d-24265221328c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:43.959024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db987ab8-3557-47ae-878d-24265221328c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:43.959305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db987ab8-3557-47ae-878d-24265221328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:43.977718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-db987ab8-3557-47ae-878d-24265221328c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:43.978944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-db987ab8-3557-47ae-878d-24265221328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:43.994072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872fd95-6afe-473f-9568-c748b11ec521 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.004736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:44.051274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 27/50] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:44.103276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872fd95-6afe-473f-9568-c748b11ec521 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.137291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.137922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.138202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.138475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.149403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:44.154105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:44.155123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:44.156028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 24/51] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:44.161261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db987ab8-3557-47ae-878d-24265221328c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.237635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:44.262616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db987ab8-3557-47ae-878d-24265221328c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.297042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.297653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.297930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.298201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.298900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:44.299206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:44.300594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:44.308479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 28/52] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:44.312732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.313761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.379459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:44.413500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4531a1-7b27-4f0a-ba65-6ffab4e1c00c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.417798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19cd6a-4623-421e-8db5-4b2148262c45 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.448126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.448761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.449038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.449310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.450419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:44.451343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.451907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:44.452013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.452238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.452510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.453625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:44.453718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:44.455159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:44.456716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 29/54] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:44 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:44.459119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.462124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.471025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:44.558242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1386a-5ac6-4260-ab0a-947882e72b2c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.559717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d486eff-709a-4de6-86ba-9147fac4d7c4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.595201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240876d-d609-4252-b91f-b753088aec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.595813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240876d-d609-4252-b91f-b753088aec20 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.596096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240876d-d609-4252-b91f-b753088aec20 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.596427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240876d-d609-4252-b91f-b753088aec20 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.597031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240876d-d609-4252-b91f-b753088aec20 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:44.597889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.598485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240876d-d609-4252-b91f-b753088aec20 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:44.598573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.598823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.599095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.600222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:44.601662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:44.603419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 30/55] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:44.603604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:44.609080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:44.630717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 26/56] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Aug 12 10:33:44 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:33:44.691086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:44.717833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab49194-c302-49b6-8e2f-b1732dde6274 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:44.754318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:44.754974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:44.755252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:44.755521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:44.756280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.domain.id=default, user.id=27ab679ee4a24103a432644a1ffbc5b2) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:44.756582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:44.758034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898b562-574d-462c-8a80-974f15638d67 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:44.764596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 31/57] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Aug 12 10:33:44 2022] GET /identity/v3/role_assignments?user.id=27ab679ee4a24103a432644a1ffbc5b2&scope.domain.id=default&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:46.523400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9575e-b55b-47b6-a97b-f5cdbccd9a4c None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:46.524224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9575e-b55b-47b6-a97b-f5cdbccd9a4c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:46.524224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9575e-b55b-47b6-a97b-f5cdbccd9a4c None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:46.526372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 27/58] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:46.535107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:46.535506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:46.535746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:46.555861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:46.557060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:46.625641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 32/59] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:46.902047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9575e-b55b-47b6-a97b-f5cdbccd9a4c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:47.034224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9575e-b55b-47b6-a97b-f5cdbccd9a4c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:47.070866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e90d1d-8552-4e84-b4e7-31f699cc5ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:47.071493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e90d1d-8552-4e84-b4e7-31f699cc5ed6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:47.071774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e90d1d-8552-4e84-b4e7-31f699cc5ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:47.072051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e90d1d-8552-4e84-b4e7-31f699cc5ed6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:47.073306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e90d1d-8552-4e84-b4e7-31f699cc5ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:47.074812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e90d1d-8552-4e84-b4e7-31f699cc5ed6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:47.076414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 28/60] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:47.082529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:47.151284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:47.188070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0446b-91d9-4455-ad11-2bb05a401ee1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:47.223310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525059a-5a39-464b-bfdf-c51dfc92fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:47.223914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525059a-5a39-464b-bfdf-c51dfc92fdbd None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:47.224196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525059a-5a39-464b-bfdf-c51dfc92fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:47.224512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525059a-5a39-464b-bfdf-c51dfc92fdbd None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:47.225160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525059a-5a39-464b-bfdf-c51dfc92fdbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:47.226621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525059a-5a39-464b-bfdf-c51dfc92fdbd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:47.255066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 33/61] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:33:47 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:33:50.169619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097a3e-3942-4f58-9fbb-6e284bcf92c1 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.169619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097a3e-3942-4f58-9fbb-6e284bcf92c1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.169619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85097a3e-3942-4f58-9fbb-6e284bcf92c1 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.169619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 29/62] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:50.175069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e704de-486d-4896-82e5-6a8bf88a5bf3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.175468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e704de-486d-4896-82e5-6a8bf88a5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.177027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e704de-486d-4896-82e5-6a8bf88a5bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.203108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c1e704de-486d-4896-82e5-6a8bf88a5bf3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:50.204508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c1e704de-486d-4896-82e5-6a8bf88a5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:50.296308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 34/63] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:50.503725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695fa0c-89db-4249-babe-7c99f4b2beb7 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.504107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695fa0c-89db-4249-babe-7c99f4b2beb7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.504308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695fa0c-89db-4249-babe-7c99f4b2beb7 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.505662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 30/64] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:50.510936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b26500-0505-4cc3-b350-3189d66a4c80 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.511449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b26500-0505-4cc3-b350-3189d66a4c80 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.511905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b26500-0505-4cc3-b350-3189d66a4c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.535742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-58b26500-0505-4cc3-b350-3189d66a4c80 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:50.537321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-58b26500-0505-4cc3-b350-3189d66a4c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:50.592834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:50.614175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:50.676612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695fa0c-89db-4249-babe-7c99f4b2beb7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:50.708449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e797-8bcf-494e-8e19-d33edefaaf5f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.708855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e797-8bcf-494e-8e19-d33edefaaf5f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.709132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e797-8bcf-494e-8e19-d33edefaaf5f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.710487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 36/66] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:33:50.718097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.718376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.718648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.744488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:50.747404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:50.775049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:50.854481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695fa0c-89db-4249-babe-7c99f4b2beb7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:50.867230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 37/67] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:33:50.899483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:50.900174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:50.900454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:50.900726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:50.908220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:50.930831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:50.936035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:50.936877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:50.937634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:50.938199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 31/68] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:50.946569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.055986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67467d83-a6c4-49c3-b58c-c4eae351bead None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.065549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89064b-cc19-4257-9e09-6bb802d04fec None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.070190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.082926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.094348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbdc18-09c5-4ea8-bfd4-1daf49ea6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.095006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbdc18-09c5-4ea8-bfd4-1daf49ea6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.095284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbdc18-09c5-4ea8-bfd4-1daf49ea6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.095550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbdc18-09c5-4ea8-bfd4-1daf49ea6ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.104193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.104926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.105298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.105656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.106400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:51.106739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbdc18-09c5-4ea8-bfd4-1daf49ea6ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:51.106831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.108251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae16e8-87fc-498d-a6fa-72b632311ea2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-dbbbdc18-09c5-4ea8-bfd4-1daf49ea6ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:51.111752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:51.112585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:33:51.113342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 38/69] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:33:51.114476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6ed9c-7761-4848-9554-ca131bb849f8 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.114725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6ed9c-7761-4848-9554-ca131bb849f8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.115039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6ed9c-7761-4848-9554-ca131bb849f8 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.116262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 39/70] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:51.117528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb68be-e6db-4f8c-a341-241f3c446dc3 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.117995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb68be-e6db-4f8c-a341-241f3c446dc3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.118480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb68be-e6db-4f8c-a341-241f3c446dc3 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.120193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 40/71] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:51.121168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb68be-e6db-4f8c-a341-241f3c446dc3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.129912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 32/72] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:33:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:51.135912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6eec6-923a-40c6-b31d-0a6d9ca25921 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.135912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6eec6-923a-40c6-b31d-0a6d9ca25921 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.135912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6eec6-923a-40c6-b31d-0a6d9ca25921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.151652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-36c6eec6-923a-40c6-b31d-0a6d9ca25921 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:51.152850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-36c6eec6-923a-40c6-b31d-0a6d9ca25921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:51.219013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 33/73] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:51.220966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.221243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.221601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.223463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb68be-e6db-4f8c-a341-241f3c446dc3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.238739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:51.239963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:51.258103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.258743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.259030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.259302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.259973 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:51.260279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.261680 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.274208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 41/74] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:51.274208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.308124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.313367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 34/75] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:51.323586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.365183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.383012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7548bf1-4fa0-423b-874a-e600f49b2e13 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.419483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.420272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.420650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.421021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.434853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.436476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.438189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 42/76] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:51.442849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.461977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963026f-cd81-456d-a3cc-5a694d7ddba2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.505330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.506076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.506360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.506629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.516971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:51.521733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:51.522568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:51.523370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 35/77] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:51.524010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.543366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.551590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818cb3-9105-4ee6-83f4-4f477969ecdd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.589333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.590438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.590745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.591162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.592288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.593746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.595341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 43/78] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:51.596096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.618722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.624804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29513b-2da2-4017-b9f6-ae246c7b836b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.658342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.658974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.659247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.659515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.692949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e9732-2998-4cb6-b522-ef6ca944dba4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.725404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.725814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.726444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.726751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.726927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.727020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.728134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.729580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.731185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 44/79] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:51.735537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.765517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.819113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.826549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 36/80] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:33:51.827624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.840079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405989-3d73-48af-bc30-22c442e4c577 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.874341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.874899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.875174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.875440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.876096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:51.876393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:51.877752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:51.885366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 45/81] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:51.890378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.924740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efbc60-1745-4b9a-befe-8186324c1601 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:51.958858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:51.959696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:51.959969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:51.960360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:51.970935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:51.975019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:51.975661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:51.976728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:51.978042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 37/82] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:51.978911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:51.985504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b08c7-392c-448e-851e-14ed696be329 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.018018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.018622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.018928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.019202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.041080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.095337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a67764-09e7-426f-a743-87318b808d72 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.096781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.098271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.128571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.129131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.129417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.129688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.130343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.131897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.159128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 38/83] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:33:51 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:33:52.160275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.191363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.203535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 46/84] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:33:52.204185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.285464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba34b7-3a31-40df-b422-ca14edcf6232 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.305363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.312027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca086-668f-45c7-8fad-7334244167ef None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.332056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.332934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.333217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.333493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.334669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.336193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.337824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 39/85] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:52.338591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.355134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.355795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.356062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.356539 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.357466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.358986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.360896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 47/86] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:52.361760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.435420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.468371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321037e4-087e-4cf6-a348-7de246b3a1f5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.484721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a738e-daec-42c2-8adb-ea802b0e08a7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.503413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.504025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.504307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.504592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.505258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:52.505687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.507156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.516209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 40/87] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:52.517123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.525076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.526005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.526467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.526958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.528279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.529919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.531803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 48/88] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:52.532754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.566000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.629408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150a73-7697-4752-a945-8b35608d0395 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.637449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6da095-1fab-4ccd-9146-326679db4ef7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.663870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.664483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.664760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.665032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.665767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=bd911b6ba3b44b0c99a37ead1cf8511c) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:52.666073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.666989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.667719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.676378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.676904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 41/89] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/role_assignments?user.id=bd911b6ba3b44b0c99a37ead1cf8511c&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=4dfba98327a94751bce3982770d6465f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:52.677587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.677959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.678421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.678903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.753511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.755747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.843151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4db5a-838e-4619-8f2f-434688ef85b1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:52.853404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:52.886917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:52.887900 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:52.888399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:52.888862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:52.890603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:52.892307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:52.894107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 42/90] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:52.895102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.937428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 49/91] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:33:52.938620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:52.998449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:53.068283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62de2a-c2e1-4aa0-b43b-d083c8bf411c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:53.109067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:53.109685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:53.109967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:53.110243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:53.111004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=27ab679ee4a24103a432644a1ffbc5b2) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:53.111312 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:53.116670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:53.127571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 43/92] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/role_assignments?user.id=27ab679ee4a24103a432644a1ffbc5b2&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:53.128396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:53.152616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bfe08-aad0-46d1-89ff-57c7d4ea73a3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:53.212251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:53.212882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:53.213161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:53.213498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:53.236808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:53.364594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e594f6a-ea95-4007-8537-3c53436ae4aa None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:53.368178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:53.370126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:53.399700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:53.432088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:53.432751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:53.433034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:53.433310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:53.434462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:53.435958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:53.437613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 44/93] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:53 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:53.446824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:53.507689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 50/94] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:33:53.513555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:53.589444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5cfd-c75b-4960-a0c7-c109cd7c1a8b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:53.609980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:53.658242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:53.658801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:53.659088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:53.659364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:53.660128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] RBAC: Adding query filter params (role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=bd911b6ba3b44b0c99a37ead1cf8511c) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:53.660437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:53.661946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:53.674858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 45/95] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:33:53 2022] GET /identity/v3/role_assignments?user.id=bd911b6ba3b44b0c99a37ead1cf8511c&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=847d13d004f94d888ecf8be41cb07086 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:53.727311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe54a7-9e3a-4738-858b-6f8b33760179 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:53.760903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:53.774551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5f6b6-af94-4e89-977c-689aa60e2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:53.775230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5f6b6-af94-4e89-977c-689aa60e2c58 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:53.775520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5f6b6-af94-4e89-977c-689aa60e2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:53.775789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5f6b6-af94-4e89-977c-689aa60e2c58 None admin] PATH_INFO: `/v3/projects/f263b6407fd6475e922d25bffdd99968` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:53.779361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5f6b6-af94-4e89-977c-689aa60e2c58 None admin] RBAC: Authorizing `identity:get_project(project_id=f263b6407fd6475e922d25bffdd99968)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:53.781009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5f6b6-af94-4e89-977c-689aa60e2c58 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:53.783058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 51/96] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:53 2022] GET /identity/v3/projects/f263b6407fd6475e922d25bffdd99968 => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:53.789118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:53.955847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7bf38-eaed-47e8-b2e2-224fb60ab670 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:53.998057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:53.998695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:53.998979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:53.999255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:53.999999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=f263b6407fd6475e922d25bffdd99968, user.id=bd911b6ba3b44b0c99a37ead1cf8511c) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:54.000308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:54.001765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c8fec-4b66-4219-b7f4-9e4d9e0bb1c4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:54.007435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 46/97] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:33:53 2022] GET /identity/v3/role_assignments?user.id=bd911b6ba3b44b0c99a37ead1cf8511c&scope.project.id=f263b6407fd6475e922d25bffdd99968&role.id=4dfba98327a94751bce3982770d6465f => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:54.977778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe859c-2ea0-4f9e-90ae-df99a0b7b2da None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:54.978287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe859c-2ea0-4f9e-90ae-df99a0b7b2da None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:54.978287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe859c-2ea0-4f9e-90ae-df99a0b7b2da None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:54.979984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 52/98] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:54.984935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c93eca-12f8-4a71-8db4-3f1e18c83850 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:54.985362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c93eca-12f8-4a71-8db4-3f1e18c83850 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:54.985550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c93eca-12f8-4a71-8db4-3f1e18c83850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.006175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f7c93eca-12f8-4a71-8db4-3f1e18c83850 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:55.008085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f7c93eca-12f8-4a71-8db4-3f1e18c83850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:55.045150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:55.092257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 47/99] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:55.107236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331e2af-3a4d-4730-ab34-b4d2cdbc7152 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.107539 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331e2af-3a4d-4730-ab34-b4d2cdbc7152 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.107786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331e2af-3a4d-4730-ab34-b4d2cdbc7152 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.109147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 53/100] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:55.115935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.116221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.116503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.143734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:55.144940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:55.152758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cfe06-afcd-4c40-a7ec-2f5cb0a08ba1 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.153042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cfe06-afcd-4c40-a7ec-2f5cb0a08ba1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.153315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cfe06-afcd-4c40-a7ec-2f5cb0a08ba1 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.154951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 54/101] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:55.159999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569b09-eb8a-424e-895e-4258774b151c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.160284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569b09-eb8a-424e-895e-4258774b151c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.160559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1569b09-eb8a-424e-895e-4258774b151c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.185720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f1569b09-eb8a-424e-895e-4258774b151c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:55.187817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f1569b09-eb8a-424e-895e-4258774b151c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:55.277070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 48/102] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:55.295328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 55/103] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:55.488697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:55.510733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a1f2-2f73-457e-bfa1-2dd18c7eeb78 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.511043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a1f2-2f73-457e-bfa1-2dd18c7eeb78 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.511287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a1f2-2f73-457e-bfa1-2dd18c7eeb78 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.512637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 56/104] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:33:55.517888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.518166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.518440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.540898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:55.542084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:55.643656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:55.651245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 57/105] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:33:55.651605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08369227-ea7c-407c-ad09-0d93a5a4d738 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:55.652179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:55.699367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:55.700003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.700278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.700545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.725460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:55.731171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:55.731994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:33:55.732730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 49/106] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:55.742239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:55.772789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:55.848734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fd78c-3b3d-47c8-b191-c5a393f2d291 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:55.914412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:55.915077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:55.915353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:55.915619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:55.933522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:55.940702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:55.941607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:55.942367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:33:55.945051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 58/107] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:55.945951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:55.954130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d555f0d-7bbc-4402-9c1c-9dd81e7400c5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.016914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.018434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.019225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.019660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.020468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] RBAC: Adding query filter params (name=reader) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:56.020920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.023102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.034872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 50/108] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:33:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:56.036408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.060174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.078241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162b085-d14c-4c1c-aad5-210371ca90ff None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.101808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.128747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.130120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.130797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.131086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.132330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.134929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.136854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 59/109] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:56.137688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.157811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a41894-50a3-40b1-bf65-f956f74e4ebc None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.204779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.206332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.206844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.207554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.208723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:56.210160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.211793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.224498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 51/110] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:56.225348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.247174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013415da-d37a-4fc4-8a2e-4574441c8b5b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.298665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.299878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.300909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.301362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.313843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.317432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:56.324606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:56.325497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:33:56.326246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:33:56.326843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 60/111] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:56.327424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.337855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e930-f469-44a0-a3d4-71545136d843 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.372845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.373397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.373676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.373947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] PATH_INFO: `/v3/users/760c4f5b7bb841da8d3a8a434486a6c7` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.377321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.389579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=760c4f5b7bb841da8d3a8a434486a6c7)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.391415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.397660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 52/112] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/users/760c4f5b7bb841da8d3a8a434486a6c7 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:56.397660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.439068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291eaa2-f3e3-423e-9a44-1df683bd9b12 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.476826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3311fac-edac-4fc6-bbd8-11b5e4af2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.477454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3311fac-edac-4fc6-bbd8-11b5e4af2f45 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.477736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3311fac-edac-4fc6-bbd8-11b5e4af2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.478012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3311fac-edac-4fc6-bbd8-11b5e4af2f45 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.478696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3311fac-edac-4fc6-bbd8-11b5e4af2f45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.480194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3311fac-edac-4fc6-bbd8-11b5e4af2f45 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.514291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3868a-1347-48ba-8211-cf56d3f95eb3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.515231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 61/113] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:33:56 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:33:56.522333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abddd-8551-4219-b4ab-7e63e3827253 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.522333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abddd-8551-4219-b4ab-7e63e3827253 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.522333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9abddd-8551-4219-b4ab-7e63e3827253 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.522333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 62/114] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:56.522333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abddd-8551-4219-b4ab-7e63e3827253 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.572855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.573822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.574185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.575381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.576847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.579135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.582380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 53/115] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:56.583626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.587740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.659867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.671165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9abddd-8551-4219-b4ab-7e63e3827253 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.707113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66418b4-b5f4-4585-94ed-bddfe074b8a8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.709679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.710299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.710590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.710967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.711647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:56.711959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.713355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c98ed48-119a-470e-8094-a1159c7a1aab None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.725475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 63/116] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:56.726483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.726817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.727060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.747012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:56.748521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:56.756678 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:56.758420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:56.758719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:56.759017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:56.832385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 64/117] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:56.833196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:56.851647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:56.853819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:56.857578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.935261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:56.952908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231f9dc-e01c-40be-8243-5411c2a9a0eb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:56.985385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 54/118] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:33:56.986620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.003204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ac131-72a8-4f65-b192-5ce33d8bbde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.004425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ac131-72a8-4f65-b192-5ce33d8bbde5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.004896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ac131-72a8-4f65-b192-5ce33d8bbde5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.005679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ac131-72a8-4f65-b192-5ce33d8bbde5 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.007403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ac131-72a8-4f65-b192-5ce33d8bbde5 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.009572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ac131-72a8-4f65-b192-5ce33d8bbde5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.012290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 65/119] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:57.014361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f372c-a262-4e04-9862-ce4ba3b587d1 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.015424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f372c-a262-4e04-9862-ce4ba3b587d1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.016299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f372c-a262-4e04-9862-ce4ba3b587d1 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.018562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 66/120] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:57.020111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f372c-a262-4e04-9862-ce4ba3b587d1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.096462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b1ce9-cd76-427a-820e-bafae7e29e7e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.100030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:57.135128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.135871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.136153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.136423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.137548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.139075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.141125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 55/121] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:56 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:57.141716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.151867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f372c-a262-4e04-9862-ce4ba3b587d1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.188850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e1d1-266b-43dd-9001-9c5d20c388f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.189766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e1d1-266b-43dd-9001-9c5d20c388f6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.190245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e1d1-266b-43dd-9001-9c5d20c388f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.190730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e1d1-266b-43dd-9001-9c5d20c388f6 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.192030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e1d1-266b-43dd-9001-9c5d20c388f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.193773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e1d1-266b-43dd-9001-9c5d20c388f6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.195570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 67/122] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:57.196802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.197242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.197641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.215249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:57.216605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:57.234074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:57.253511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6209248-91e8-404d-b1eb-d7f4ddaf2285 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.298714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 68/123] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:57.298714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.302200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.303051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.303405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.303797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/bd911b6ba3b44b0c99a37ead1cf8511c/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.306028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0aca8423147fcaef5d2488c86f1a4, user_id=bd911b6ba3b44b0c99a37ead1cf8511c, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.308014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.324071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 56/124] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:33:57 2022] PUT /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/bd911b6ba3b44b0c99a37ead1cf8511c/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:33:57.325148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.384461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:57.425529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1827666b-4aa4-4162-b68d-b929a40e5674 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.469315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.469889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.470167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.470439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.484262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:57.489432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:57.490461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:33:57.491244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:33:57.491838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 69/125] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:57.493008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.512003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:57.533056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09a08-8e68-494e-9078-d6eb5b682617 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.597385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.598841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.599389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.599850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.601505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.604014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.606162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 57/126] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:57.607502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.624644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132237ae-912b-449c-bd29-6e1b9e9ddadf None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.671979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.672768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.673145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.673511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.674427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] RBAC: Adding query filter params (role.id=93b8aa5cf7004027892f201f9b873be1, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=760c4f5b7bb841da8d3a8a434486a6c7) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:57.674863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.677662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.690812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 70/127] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/role_assignments?user.id=760c4f5b7bb841da8d3a8a434486a6c7&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=93b8aa5cf7004027892f201f9b873be1 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:57.692173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.762276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:57.766271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f146541-ac3a-4daf-893c-0f8c50a119a8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.836631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.837266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.837545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.837817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.838512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:57.838855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:57.840288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:57.860716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 58/128] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:57.861410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.863957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:57.897517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04450b43-7058-404f-a797-8bbc64af39fb None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:57.935206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:57.936307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:57.936778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:57.937238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:57.949051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:33:57.954796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:33:57.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:33:57.956410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:33:57.958865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 71/129] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:33:57.960151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:57.987176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988906d-5798-4782-ac00-0af95fce34cc None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.030604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.031591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.032945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.033365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/27ab679ee4a24103a432644a1ffbc5b2/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.039826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0aca8423147fcaef5d2488c86f1a4, user_id=27ab679ee4a24103a432644a1ffbc5b2, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.041612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.071454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 59/130] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:33:57 2022] PUT /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/27ab679ee4a24103a432644a1ffbc5b2/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:33:58.072547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:58.110058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:58.158846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4f043-15f3-4932-95ea-dd3407c21d76 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.229799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d227-b5a9-4311-a1bb-c38ce296cc19 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.272998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.273984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.274465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.274981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.276032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:33:58.276538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.278260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.289496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 60/131] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:33:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:58.296512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:58.298106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.298811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.299078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.299350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.300503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.301977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.304093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 72/132] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:57 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:58.312938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:58.325482 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:58.449648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:58.478106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793be61e-c72e-45b8-8b5a-aa8392b6e9db None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.486455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05024c33-58a7-4248-a398-65eb31289549 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.544141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.544707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.544996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.545271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.547064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.549283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.550906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 61/133] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:33:58 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:33:58.554306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.554997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.555533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.555821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.557025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.558497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.560161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 73/134] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:58 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:58.561053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:58.565692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:58.702314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:58.748655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c674a9-e1ae-432d-a4b4-82f0f7d52e6b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.782690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a96e5a-92b7-4b27-9c84-5d9c6d979e39 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:58.810927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995375-e64f-46a0-9728-30c023c0bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.812057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995375-e64f-46a0-9728-30c023c0bbbb None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.813365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995375-e64f-46a0-9728-30c023c0bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.815089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995375-e64f-46a0-9728-30c023c0bbbb None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/bd911b6ba3b44b0c99a37ead1cf8511c/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.819022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995375-e64f-46a0-9728-30c023c0bbbb None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0aca8423147fcaef5d2488c86f1a4, user_id=bd911b6ba3b44b0c99a37ead1cf8511c, role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.820765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995375-e64f-46a0-9728-30c023c0bbbb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.846068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 74/135] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:33:58 2022] PUT /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/bd911b6ba3b44b0c99a37ead1cf8511c/roles/847d13d004f94d888ecf8be41cb07086 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:33:58.847905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:58.849766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.850764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feafb3-5ee3-4892-8225-e2a5ba93814c None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.851302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.851799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] PATH_INFO: `/v3/projects/f263b6407fd6475e922d25bffdd99968` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.852301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feafb3-5ee3-4892-8225-e2a5ba93814c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.853356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feafb3-5ee3-4892-8225-e2a5ba93814c None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.855240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 75/136] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:33:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:33:58.861178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] RBAC: Authorizing `identity:get_project(project_id=f263b6407fd6475e922d25bffdd99968)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:58.862126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:58.864020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:58.864888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:58.865450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:58.870523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 62/137] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:33:58 2022] GET /identity/v3/projects/f263b6407fd6475e922d25bffdd99968 => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:58.876052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:58.902283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:33:58.906606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:33:58.919745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:59.028685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 76/138] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:33:59.089815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006930c-736d-4fee-b30d-656e8623858d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:59.143646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:59.144409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:59.144608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:59.144885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] PATH_INFO: `/v3/projects/f263b6407fd6475e922d25bffdd99968/users/bd911b6ba3b44b0c99a37ead1cf8511c/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:59.147008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=f263b6407fd6475e922d25bffdd99968, user_id=bd911b6ba3b44b0c99a37ead1cf8511c, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:59.148687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:59.167911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 63/139] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:33:58 2022] PUT /identity/v3/projects/f263b6407fd6475e922d25bffdd99968/users/bd911b6ba3b44b0c99a37ead1cf8511c/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:33:59.438326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:59.517848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:59.569954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee4c2d-29b4-42f3-b7ac-9e2a764d9839 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:59.610303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9295c44-5f40-44f0-8a13-6c49afe837c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:59.611324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9295c44-5f40-44f0-8a13-6c49afe837c0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:59.611810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9295c44-5f40-44f0-8a13-6c49afe837c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:59.612270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9295c44-5f40-44f0-8a13-6c49afe837c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:59.613590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9295c44-5f40-44f0-8a13-6c49afe837c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:59.615344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9295c44-5f40-44f0-8a13-6c49afe837c0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:59.617138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 77/140] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:33:59.622962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:33:59.729275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:33:59.752767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9c7c-8aae-4cbb-8d6d-54b4e5171c9b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:33:59.808316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b372604-779f-4161-9c5a-5745b6e6ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:33:59.808994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372604-779f-4161-9c5a-5745b6e6ba73 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:33:59.809279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372604-779f-4161-9c5a-5745b6e6ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:33:59.809553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b372604-779f-4161-9c5a-5745b6e6ba73 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:33:59.810210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372604-779f-4161-9c5a-5745b6e6ba73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:33:59.811735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b372604-779f-4161-9c5a-5745b6e6ba73 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:33:59.837471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 64/141] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:33:59 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:00.276157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95c71-bfce-4af7-9a12-18f333f2975d None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.276703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95c71-bfce-4af7-9a12-18f333f2975d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.277087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95c71-bfce-4af7-9a12-18f333f2975d None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.278831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 78/142] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:00.284824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5caad-4cfc-4efd-8f50-be98fc33bb2d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.285306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5caad-4cfc-4efd-8f50-be98fc33bb2d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.285386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5caad-4cfc-4efd-8f50-be98fc33bb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.306735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f9d5caad-4cfc-4efd-8f50-be98fc33bb2d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:00.308006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f9d5caad-4cfc-4efd-8f50-be98fc33bb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:00.404157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 65/143] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:00.472991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cf0d3-ff70-4b13-946c-bdad86a471da None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.473962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cf0d3-ff70-4b13-946c-bdad86a471da None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.474447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cf0d3-ff70-4b13-946c-bdad86a471da None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.476054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 79/144] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:00.481398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60d82-6ddf-4e6b-a05d-ec9350b4df1e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.481692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60d82-6ddf-4e6b-a05d-ec9350b4df1e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.481969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf60d82-6ddf-4e6b-a05d-ec9350b4df1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.508371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ebf60d82-6ddf-4e6b-a05d-ec9350b4df1e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:00.509646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ebf60d82-6ddf-4e6b-a05d-ec9350b4df1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:00.595741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:00.604675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 66/145] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:00.665463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c513c6d-f0cf-41a9-b275-cf82295d4fca None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.665787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c513c6d-f0cf-41a9-b275-cf82295d4fca None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.666016 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c513c6d-f0cf-41a9-b275-cf82295d4fca None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.667556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 80/146] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:00.679341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.679627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.679906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.703737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:00.704996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:00.777820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c513c6d-f0cf-41a9-b275-cf82295d4fca None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:00.826149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 67/147] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:00.921279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c513c6d-f0cf-41a9-b275-cf82295d4fca None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:00.954616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:00.960573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:00.961368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:00.961853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:00.962124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:00.980643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:00.986157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:00.991360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:00.992236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:00.993791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 81/148] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:00.998441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.170789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5c4fa-fd1c-4874-9120-7ba99b4caa77 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.200027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37912f8b-8a26-4be5-be90-4711d9348344 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.213958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:01.240348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.240996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.241276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.241565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.244649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.245484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.245951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.246397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.247397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:01.247900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:01.249694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:01.258719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 82/149] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:01.264443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.266316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:01.273171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:01.274032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:01.274806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:01.285639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 68/150] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:01.292305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.336581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:01.383296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f110fcd-4df4-42dd-a18b-24fefa5d99d2 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.419856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a116-3821-4f3c-946d-70321568058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.420503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a116-3821-4f3c-946d-70321568058f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.420785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a116-3821-4f3c-946d-70321568058f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.421053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485a116-3821-4f3c-946d-70321568058f None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.426789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485a116-3821-4f3c-946d-70321568058f None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:01.428324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485a116-3821-4f3c-946d-70321568058f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:01.429954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 83/151] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:01 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:01.430766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a116-3821-4f3c-946d-70321568058f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.477855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b65c3-6b2e-4df0-819d-43b320a58479 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.551437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.552137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.552418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.552690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.559124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485a116-3821-4f3c-946d-70321568058f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.572617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:01.577344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:01.578271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:01.579156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 69/152] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:01.580899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.591662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:01.606500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.607167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.607447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.607719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.608404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:01.608708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:01.610100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:01.619603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 84/153] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:01.620546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.664631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:01.749572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f74f7-9f9d-4c99-a048-f4651b26c5a9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.768269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae563e-f116-415a-a374-e27b159649b8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:01.787990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.788613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.788892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.789161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.789836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:01.790140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:01.791562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:01.800371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 85/154] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:01.801207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:01.848866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:01.849982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:01.851597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:01.852707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:01.903854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:02.000567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836549f-f4a9-4f58-82c0-0d7053eddf57 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:02.015354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.017054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.063051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecaabe-98d0-4a28-b7af-f3d5227ed704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:02.063962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecaabe-98d0-4a28-b7af-f3d5227ed704 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.065026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecaabe-98d0-4a28-b7af-f3d5227ed704 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.065448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecaabe-98d0-4a28-b7af-f3d5227ed704 None admin] PATH_INFO: `/v3/users/760c4f5b7bb841da8d3a8a434486a6c7` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.067465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecaabe-98d0-4a28-b7af-f3d5227ed704 None admin] RBAC: Authorizing `identity:get_user(user_id=760c4f5b7bb841da8d3a8a434486a6c7)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.071534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecaabe-98d0-4a28-b7af-f3d5227ed704 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.073340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 86/155] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:01 2022] GET /identity/v3/users/760c4f5b7bb841da8d3a8a434486a6c7 => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:02.076919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8435cf-334e-4b55-897d-4c8fc6b228a3 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.077381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8435cf-334e-4b55-897d-4c8fc6b228a3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.078593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8435cf-334e-4b55-897d-4c8fc6b228a3 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.083651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 87/156] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:02.084652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8435cf-334e-4b55-897d-4c8fc6b228a3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:02.102670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:02.187163 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 70/157] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:02.188054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:02.313029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6a1aa-6d65-48a4-b351-53161ee7b81b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:02.352391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240e8a9-fc71-41a1-b0ba-b1d53a2eb00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:02.353035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240e8a9-fc71-41a1-b0ba-b1d53a2eb00a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.353318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240e8a9-fc71-41a1-b0ba-b1d53a2eb00a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.353589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240e8a9-fc71-41a1-b0ba-b1d53a2eb00a None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.355969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240e8a9-fc71-41a1-b0ba-b1d53a2eb00a None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.357437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240e8a9-fc71-41a1-b0ba-b1d53a2eb00a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.360176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 71/158] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:02 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:02.361339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.361618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.361887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.372684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8435cf-334e-4b55-897d-4c8fc6b228a3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:02.398388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:02.403984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:02.405190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:02.426239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:02.437583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:02.438233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.438510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.442843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] PATH_INFO: `/v3/users/27ab679ee4a24103a432644a1ffbc5b2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.444702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] RBAC: Authorizing `identity:get_user(user_id=27ab679ee4a24103a432644a1ffbc5b2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.446190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.448039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 88/159] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:02 2022] GET /identity/v3/users/27ab679ee4a24103a432644a1ffbc5b2 => generated 247 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:02.448591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:02.537070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 72/160] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:02.538924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:02.654511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172ab4e-ea1f-4c66-acbf-ee6eb92130bb None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:02.718359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d021d3-39d9-4d63-bd07-6591cf634c41 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:02.745720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:02.746381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.746662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.746965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.751415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.752903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.753009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e57211-fb1d-450a-9bb7-1c69df87bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:02.753581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57211-fb1d-450a-9bb7-1c69df87bb2a None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.753865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57211-fb1d-450a-9bb7-1c69df87bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.754145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e57211-fb1d-450a-9bb7-1c69df87bb2a None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/760c4f5b7bb841da8d3a8a434486a6c7/roles/93b8aa5cf7004027892f201f9b873be1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.754928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 89/161] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:02 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:02.755550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:02.756176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e57211-fb1d-450a-9bb7-1c69df87bb2a None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0aca8423147fcaef5d2488c86f1a4, user_id=760c4f5b7bb841da8d3a8a434486a6c7, role_id=93b8aa5cf7004027892f201f9b873be1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.757718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e57211-fb1d-450a-9bb7-1c69df87bb2a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.780630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 73/162] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:02 2022] PUT /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/users/760c4f5b7bb841da8d3a8a434486a6c7/roles/93b8aa5cf7004027892f201f9b873be1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:02.782226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ccdc-5e3b-4229-97a3-abe6b25358ef None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.782515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ccdc-5e3b-4229-97a3-abe6b25358ef None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.782814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50ccdc-5e3b-4229-97a3-abe6b25358ef None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.788297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 74/163] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:02.788915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ccdc-5e3b-4229-97a3-abe6b25358ef None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:02.805262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:02.875735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:02.950095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50ccdc-5e3b-4229-97a3-abe6b25358ef None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:02.985621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:02.986266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.986506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.986808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:02.988041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=bd911b6ba3b44b0c99a37ead1cf8511c) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:02.988041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:02.993610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34663d8c-f53d-4393-b615-fb8924f60986 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:02.996431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 75/164] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:02 2022] GET /identity/v3/role_assignments?user.id=bd911b6ba3b44b0c99a37ead1cf8511c&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=4dfba98327a94751bce3982770d6465f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:02.997664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:02.997891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:02.998167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.018483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:03.019917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:03.044814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d4f01-faa6-40df-a3fc-2ba97c9c8270 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:03.126519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:03.133513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 76/165] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:03.159046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:03.159669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:03.159942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:03.160210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.162407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:03.307492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b999b3-a2ee-48ab-89cd-41e24d950f8c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:03.365615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:03.366264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:03.366539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:03.366840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.379499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:03.381171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:03.395764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:03.400604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:03.401489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:03.403090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 77/166] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:03.407609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:03.507787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:03.529177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:03.601045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea92f3e-c7d3-40a5-9200-8ab7669c501b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:03.619258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 90/167] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 864 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:03.625111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:03.660359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:03.661760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:03.662233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:03.662706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.663599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:03.664092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:03.665681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:03.682785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 78/168] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:03.688530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:03.837896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177af82-0c12-4bae-96a0-7f407d1ec502 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:03.842434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335ffdb-28ab-43b1-b425-836e1b2bc35f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:03.887042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:03.907025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:03.907673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:03.907954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:03.908226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.909455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:03.910951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:03.913053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 91/169] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:03 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:03.913822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:03.933949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282b9ea-a306-4d37-89fd-1849131c1673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:03.934599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b9ea-a306-4d37-89fd-1849131c1673 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:03.934907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b9ea-a306-4d37-89fd-1849131c1673 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:03.935183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282b9ea-a306-4d37-89fd-1849131c1673 None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.937020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b9ea-a306-4d37-89fd-1849131c1673 None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:03.938489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282b9ea-a306-4d37-89fd-1849131c1673 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:03.942177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 79/170] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:03 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:03.943397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ebd22-87fd-4ea7-a2af-ad48b6c2caae None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:03.943676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ebd22-87fd-4ea7-a2af-ad48b6c2caae None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:03.943949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ebd22-87fd-4ea7-a2af-ad48b6c2caae None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:03.945325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 80/171] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:03.945868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ebd22-87fd-4ea7-a2af-ad48b6c2caae None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:03.957293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.076543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf221b8-61c1-4006-8fbe-8b6cadb1d2da None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:04.118523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:04.119562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.119981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.120626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.134702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:04.141523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:04.142555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:04.143596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:04.146111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 92/172] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:04.147134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:04.160518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ebd22-87fd-4ea7-a2af-ad48b6c2caae None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:04.205591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:04.206501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.206944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.207352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.208299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=27ab679ee4a24103a432644a1ffbc5b2) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:04.209276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:04.211192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feff728-d91a-4cd2-ad17-18278eb07c45 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:04.220003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 81/173] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:03 2022] GET /identity/v3/role_assignments?user.id=27ab679ee4a24103a432644a1ffbc5b2&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:04.221008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d231f-516f-4574-9705-e70c059f4fa9 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.221290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d231f-516f-4574-9705-e70c059f4fa9 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.221561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d231f-516f-4574-9705-e70c059f4fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.243135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5d6d231f-516f-4574-9705-e70c059f4fa9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:04.245821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5d6d231f-516f-4574-9705-e70c059f4fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:04.259163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.307393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.313603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398ae21-4c32-43f8-b462-f613696b68aa None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:04.334650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 82/174] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:04.336784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027beb7b-a74b-41df-aa2b-31c1c2e4404b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.337442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027beb7b-a74b-41df-aa2b-31c1c2e4404b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.338012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027beb7b-a74b-41df-aa2b-31c1c2e4404b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.339527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 83/175] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:04.340462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027beb7b-a74b-41df-aa2b-31c1c2e4404b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:04.403257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e28418-02f1-450c-9bef-980657133404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:04.403797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e28418-02f1-450c-9bef-980657133404 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.404129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e28418-02f1-450c-9bef-980657133404 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.404395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e28418-02f1-450c-9bef-980657133404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.469249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027beb7b-a74b-41df-aa2b-31c1c2e4404b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:04.513051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:04.514004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.514474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.515296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.516354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:04.516860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:04.518637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a8bf6-8dee-4608-abd3-e991ff74a2a2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:04.518961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e28418-02f1-450c-9bef-980657133404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:04.520466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e28418-02f1-450c-9bef-980657133404 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:04.530329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 84/176] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:04.532601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.533112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.533969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.558276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:04.560927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:04.610499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.627792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.642356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 93/177] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:04.644043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 85/178] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:04.646642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:04.646798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a79ab4-a85a-4723-896a-fdd9bb8d9d08 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.646798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a79ab4-a85a-4723-896a-fdd9bb8d9d08 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.647025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a79ab4-a85a-4723-896a-fdd9bb8d9d08 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.648615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 94/179] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:04.656119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a79ab4-a85a-4723-896a-fdd9bb8d9d08 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:04.812349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742efba-7b71-488d-95a7-23223536ce1a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:04.821632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a79ab4-a85a-4723-896a-fdd9bb8d9d08 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:04.849969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f471871-5a9f-4588-9a56-84532acbacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:04.850670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f471871-5a9f-4588-9a56-84532acbacf5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.851005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f471871-5a9f-4588-9a56-84532acbacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.851279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f471871-5a9f-4588-9a56-84532acbacf5 None admin] PATH_INFO: `/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.852406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f471871-5a9f-4588-9a56-84532acbacf5 None admin] RBAC: Authorizing `identity:get_user(user_id=bd911b6ba3b44b0c99a37ead1cf8511c)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:04.854093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f471871-5a9f-4588-9a56-84532acbacf5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:04.855875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 86/180] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:04 2022] GET /identity/v3/users/bd911b6ba3b44b0c99a37ead1cf8511c => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:04.857117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.857395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.857769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.866865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:04.868081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:04.868555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:04.868995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:04.870306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:04.872903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:04.879592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 95/181] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:04 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:04.880581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:04.880762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:04.882304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:04.923742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.945166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:04.963412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 87/182] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:04.963412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.009506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d9faf-2b20-4965-a297-a12af326a2ae None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.044871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.045510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.045784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.046051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.057257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:05.062052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:05.062983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:05.063991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 96/183] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:05.064646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.096246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc6b97-bd3f-4c24-b26d-503044a11947 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.144885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.146444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.146804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.147146 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.179522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06c57-b47e-40f9-9938-4ce1549d5b8c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.199295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.215383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.216056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.216337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.216604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.217388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] RBAC: Adding query filter params (role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=bd911b6ba3b44b0c99a37ead1cf8511c) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:05.217691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.219398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.225670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 97/184] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/role_assignments?user.id=bd911b6ba3b44b0c99a37ead1cf8511c&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=847d13d004f94d888ecf8be41cb07086 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:05.226880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.231082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.246942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.248550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.349885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e64bda-0b6e-4779-8857-9b317bf5bcc9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.375444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 88/185] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:05.378896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.394500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.395298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.395572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.396665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.408928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:05.416869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:05.417785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:05.418726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 98/186] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:05.419789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.457412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.465198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.500617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9c33-7fca-49ef-a804-d495ec20e83f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.537672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.538279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.538557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.538860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.539531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:05.539833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.541214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.542577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4076aba-d936-4740-9e41-091f44537c65 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.549115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 89/187] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:05.551071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.576798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.577524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.577892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.578370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.579552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.581006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.582713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 99/188] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:05.583533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.647497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe69fc-76e6-4bd0-a5d5-285cff7cf742 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.679898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.681557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519f32-1bbb-4da8-9cff-d5722f7f60c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.682440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519f32-1bbb-4da8-9cff-d5722f7f60c6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.682768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519f32-1bbb-4da8-9cff-d5722f7f60c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.683040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519f32-1bbb-4da8-9cff-d5722f7f60c6 None admin] PATH_INFO: `/v3/projects/f263b6407fd6475e922d25bffdd99968` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.683560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc826ad-eb41-40ca-b7b1-0ac16ec15a8b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.684199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519f32-1bbb-4da8-9cff-d5722f7f60c6 None admin] RBAC: Authorizing `identity:get_project(project_id=f263b6407fd6475e922d25bffdd99968)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.685661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519f32-1bbb-4da8-9cff-d5722f7f60c6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.687304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 90/189] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/projects/f263b6407fd6475e922d25bffdd99968 => generated 312 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:05.688417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3db01-5c44-4487-bcc2-5ae1364f6b6f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.688696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3db01-5c44-4487-bcc2-5ae1364f6b6f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.688966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3db01-5c44-4487-bcc2-5ae1364f6b6f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.690302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 91/190] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:05.690878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3db01-5c44-4487-bcc2-5ae1364f6b6f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.694794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.718943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.719480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.719772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.720025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.720686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:05.721044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.722417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.730137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 100/191] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:05.734724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.793173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3db01-5c44-4487-bcc2-5ae1364f6b6f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.826888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.827504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64194d0b-1953-49e8-9505-c3a8975e096f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.827637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.828038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] PATH_INFO: `/v3/users/694fbff28110406ebad67e2b9bc15389` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.840854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] RBAC: Authorizing `identity:get_user(user_id=694fbff28110406ebad67e2b9bc15389)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.842298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.843921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 92/192] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/users/694fbff28110406ebad67e2b9bc15389 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:05.844672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:05.863031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cc909-a469-4e4b-89d9-c15693d0a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.863639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc909-a469-4e4b-89d9-c15693d0a773 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.863916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc909-a469-4e4b-89d9-c15693d0a773 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.864185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cc909-a469-4e4b-89d9-c15693d0a773 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.864861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc909-a469-4e4b-89d9-c15693d0a773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.866302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cc909-a469-4e4b-89d9-c15693d0a773 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:05.886627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 101/193] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:05 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:05.892156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.892533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.892808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.903097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.912966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:05.914221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:05.928100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:05.953538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90640a6a-3e94-4377-9ae5-6356eabee2da None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:05.996190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:05.996815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:05.997090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:05.997355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:05.998102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=f263b6407fd6475e922d25bffdd99968, user.id=bd911b6ba3b44b0c99a37ead1cf8511c) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:05.998408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:05.999005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 102/194] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:05.999710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.011975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.018987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 93/195] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/role_assignments?user.id=bd911b6ba3b44b0c99a37ead1cf8511c&scope.project.id=f263b6407fd6475e922d25bffdd99968&role.id=4dfba98327a94751bce3982770d6465f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:06.030075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.151574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a45b2-eee9-4093-997f-d32b096e1a9a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.189622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.190554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e7b5d-dbe5-4d73-8b3e-db1621b8ec59 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.190878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.191337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.191821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] PATH_INFO: `/v3/users/694fbff28110406ebad67e2b9bc15389` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.193230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] RBAC: Authorizing `identity:get_user(user_id=694fbff28110406ebad67e2b9bc15389)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.194921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.197007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 103/196] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:05 2022] GET /identity/v3/users/694fbff28110406ebad67e2b9bc15389 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:06.203224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.220546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.230103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.247409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.247941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.248215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.248481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.335348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.336830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.336942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5dec6-562f-407c-93b9-b38b483923b9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.381220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.381837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.382110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.382374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.458943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.460420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.462860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 94/197] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:06.463788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.479775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.491397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.572822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 104/198] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:34:06.573737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.574754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e914ee-71f8-4677-a916-1f1ecbb0b755 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.613452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.614087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.614365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.614673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.626279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:06.631435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:06.632300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:06.633075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 95/199] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:06.638180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.676687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851799c2-deb4-484d-b157-8674de4fdf6d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.690981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.712409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.713130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.713464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.713792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.715149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.716655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.723395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 105/200] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:06.724251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.733413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.751739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070303-c6e1-4baa-ad0f-200cc6ddd9cc None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.789377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.790008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.790286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.790554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.791855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.793526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.795825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 96/201] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:06.796738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.830313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43771c7f-9b75-4199-b82f-893a85c0aa95 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.864837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.865525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.865858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.866192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.866945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:06.867310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.868853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.877630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 106/202] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:06.878438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.910881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64171-2313-4d36-ab9c-c571a63f492c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:06.924889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:06.948184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:06.948792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:06.949113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:06.949385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:06.950123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=694fbff28110406ebad67e2b9bc15389) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:06.950524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:06.952136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:06.957961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 97/203] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/role_assignments?user.id=694fbff28110406ebad67e2b9bc15389&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:06.958882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:06.983060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:07.022509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abcca8-c655-4139-9321-669028f6adb4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:07.070124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543c575-c194-48df-b765-1d696613bc18 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:07.085842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:07.086376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:07.086648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:07.086999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:07.087738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] RBAC: Adding query filter params (role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=694fbff28110406ebad67e2b9bc15389) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:07.088136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:07.089692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:07.108452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:07.108452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:07.108452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:07.108452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] PATH_INFO: `/v3/users/760c4f5b7bb841da8d3a8a434486a6c7` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:07.109223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 107/204] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/role_assignments?user.id=694fbff28110406ebad67e2b9bc15389&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=847d13d004f94d888ecf8be41cb07086 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:07.116474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] RBAC: Authorizing `identity:get_user(user_id=760c4f5b7bb841da8d3a8a434486a6c7)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:07.118038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:07.119831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 98/205] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:06 2022] GET /identity/v3/users/760c4f5b7bb841da8d3a8a434486a6c7 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:07.127902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:07.291326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cf3d-14be-475a-9bd4-e7f0381c54e9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:07.305133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:07.335939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:07.336491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:07.336770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:07.337038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:07.409755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:07.411330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:07.532773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 108/206] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:07.538570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:07.663879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:07.683723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae50e-0f12-4f8b-95e1-7f3e346434e3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:07.728344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387b649-3132-4795-bd82-e0d0756e2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:07.728990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b649-3132-4795-bd82-e0d0756e2c65 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:07.729264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b649-3132-4795-bd82-e0d0756e2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:07.729531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387b649-3132-4795-bd82-e0d0756e2c65 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:07.730648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387b649-3132-4795-bd82-e0d0756e2c65 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:07.732130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387b649-3132-4795-bd82-e0d0756e2c65 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:07.733759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 99/207] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:07 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:07.739916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:07.757223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:07.874456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de328b7-92ea-4ff8-b531-de10dc9ce767 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:07.908918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:07.909527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:07.909800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:07.910062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:07.910817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] RBAC: Adding query filter params (role.id=93b8aa5cf7004027892f201f9b873be1, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4, user.id=760c4f5b7bb841da8d3a8a434486a6c7) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:07.911120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:07.912604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19277e23-2a08-48a2-8932-c7e7a77c9deb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:07.918594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 109/208] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:07 2022] GET /identity/v3/role_assignments?user.id=760c4f5b7bb841da8d3a8a434486a6c7&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=93b8aa5cf7004027892f201f9b873be1 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:08.274926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79acfc-63aa-4a34-a0ab-99f4fe18ccf4 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.275271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79acfc-63aa-4a34-a0ab-99f4fe18ccf4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.275387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79acfc-63aa-4a34-a0ab-99f4fe18ccf4 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.276951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 100/209] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:08.282740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.283182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.283275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.289615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5ad6e-5531-4335-81b7-5c92ba55873b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.289895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5ad6e-5531-4335-81b7-5c92ba55873b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.290164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5ad6e-5531-4335-81b7-5c92ba55873b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.291802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 101/210] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:08.298008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.298291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.298560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.312813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:08.314322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:08.320493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:08.321688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:08.391536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 110/211] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:08.404719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 102/212] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:08.668918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:08.671086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:08.674809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:08.778648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdaed8-d5ee-45ea-9cf5-71301a37c5d6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:08.778991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:08.798416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf5d86-78d4-487d-8627-cdb53cf24c59 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:08.815353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:08.816305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.816859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.817338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.828051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:08.833023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:08.833926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:08.834702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:08.835317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:08.835317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.835317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.835555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.836657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:08.837305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 111/213] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:08.838110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:08.843789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 103/214] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:08.844791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:08.850906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:08.911995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:08.953218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32e686-4cdc-4018-ad25-266ecdfcf306 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:08.954978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcae64-365e-4416-9841-aef6d63ea7d9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:08.991112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:08.991981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.992569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.993035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.993876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:08.995639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:08.995944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:08.996253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:08.996526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:08.996792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:08.997460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:08.997759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:08.999164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:09.010331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 112/215] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:09.013512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:09.029347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 104/216] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:08 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:09.129168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1161075-f236-4beb-9eaf-86426b517ada None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:09.154402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:09.170148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3c50e-17a7-40da-be22-6b4fbcd457cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:09.171121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c50e-17a7-40da-be22-6b4fbcd457cc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.171530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c50e-17a7-40da-be22-6b4fbcd457cc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.171935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3c50e-17a7-40da-be22-6b4fbcd457cc None admin] PATH_INFO: `/v3/users/2146477bc2d741578db01042f5145cdc` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.187888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c50e-17a7-40da-be22-6b4fbcd457cc None admin] RBAC: Authorizing `identity:get_user(user_id=2146477bc2d741578db01042f5145cdc)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:09.189704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3c50e-17a7-40da-be22-6b4fbcd457cc None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:09.191578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 113/217] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:09 2022] GET /identity/v3/users/2146477bc2d741578db01042f5145cdc => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:09.199847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:09.210306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:09.307494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288e7f-51d2-4337-94b6-893c467a2d4b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:09.329525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2be8d-a21e-4b77-afe6-18ecf0621683 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.330036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2be8d-a21e-4b77-afe6-18ecf0621683 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.330121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2be8d-a21e-4b77-afe6-18ecf0621683 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.331565 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 114/218] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:09.337151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b0179-7e4b-49b3-a1ec-adfa1b8da516 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.337585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b0179-7e4b-49b3-a1ec-adfa1b8da516 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.337857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b0179-7e4b-49b3-a1ec-adfa1b8da516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.348133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:09.348787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.349063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.349333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.363757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f67b0179-7e4b-49b3-a1ec-adfa1b8da516 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:09.365202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f67b0179-7e4b-49b3-a1ec-adfa1b8da516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:09.430840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:09.432282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:09.442237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:09.456824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 115/219] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:09.458423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a306b-1854-4454-8ed1-4c2c464b9215 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.458881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a306b-1854-4454-8ed1-4c2c464b9215 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.459285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a306b-1854-4454-8ed1-4c2c464b9215 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.460937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 116/220] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:09.466410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.467213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.467630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.490370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:09.491965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:09.597664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 105/221] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:09.604290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 117/222] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:09.605838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:09.662341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:09.734878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc397229-41a6-4138-bd21-439e628a8d22 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:09.774593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:09.775259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.775534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.775805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.776925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:09.778436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:09.780574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 118/223] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:09 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:09.784677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:09.786268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:09.883876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05aac9-8e0a-4bd1-b7fd-ecf98cd886c1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:09.895056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:09.919418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:09.920027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:09.920305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:09.920574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:09.921301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=2146477bc2d741578db01042f5145cdc) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:09.921606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:09.923271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:09.928879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 119/224] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:09 2022] GET /identity/v3/role_assignments?user.id=2146477bc2d741578db01042f5145cdc&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=4dfba98327a94751bce3982770d6465f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:09.985875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fd412-01f9-4476-93b0-848d6d9658b7 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:09.999786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.005908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:10.030468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.031154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.031431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.031701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.057499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:10.066526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:10.067567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:10.068348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:10.069368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 106/225] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:10.075143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.178039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecb2e0-d318-457d-8d10-3cc73eb71ced None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.226261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8565c57-23b5-49a3-afe5-f1825fe8491e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.240991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.241922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.242459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.242941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.265968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:10.270965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:10.271835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:10.272628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:10.281005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 120/226] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:10.288392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.300422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.301047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.301326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.301597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.302354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:10.302657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:10.304066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:10.323537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 107/227] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:10.329450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.356993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:10.403041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:10.465285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369cd65-4b93-4c24-988c-db2a8a696f1e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.503026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.503559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.503836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.504100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.504766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:10.505121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:10.506517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:10.516023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 121/228] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:10.521651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.560692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8381504-c9cb-45d8-a030-63739d56dedd None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.632174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.634535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.639762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.640517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] PATH_INFO: `/v3/users/694fbff28110406ebad67e2b9bc15389` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.641852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=694fbff28110406ebad67e2b9bc15389)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:10.643478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:10.647662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 108/229] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:10 2022] GET /identity/v3/users/694fbff28110406ebad67e2b9bc15389 => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:10.650812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.683214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:10.693984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362a686-2aed-4f47-8f49-833f2e3e6dbf None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.760948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.761504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.761777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.762051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] PATH_INFO: `/v3/users/694fbff28110406ebad67e2b9bc15389` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.766450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] RBAC: Authorizing `identity:get_user(user_id=694fbff28110406ebad67e2b9bc15389)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:10.767937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:10.769527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 122/230] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:10 2022] GET /identity/v3/users/694fbff28110406ebad67e2b9bc15389 => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:10.776279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.854144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:10.865792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44096c83-396c-4d76-aa1b-f59f7a06f5c4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.915286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67650a2-f17e-465b-914c-443891e8d934 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:10.931447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.932105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.932436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.932712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.933951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:10.935427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:10.938077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 109/231] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:10 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:10.943148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.949802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:10.950456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:10.950757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:10.951032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:10.952152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:10.953608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:10.955559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 123/232] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:10 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:10.961140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:10.996394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:11.068601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add708a-99fd-4c1a-a6c4-2c8ef730df10 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:11.109253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae20034-bd00-4c50-9d4f-f0671d9fe34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:11.110518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20034-bd00-4c50-9d4f-f0671d9fe34d None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.111676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20034-bd00-4c50-9d4f-f0671d9fe34d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.112177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae20034-bd00-4c50-9d4f-f0671d9fe34d None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/694fbff28110406ebad67e2b9bc15389/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.116848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae20034-bd00-4c50-9d4f-f0671d9fe34d None admin] RBAC: Authorizing `identity:create_grant(project_id=34274a6be6514c5ab10310901a4b0d84, user_id=694fbff28110406ebad67e2b9bc15389, role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:11.119590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae20034-bd00-4c50-9d4f-f0671d9fe34d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:11.146293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 124/233] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:10 2022] PUT /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/694fbff28110406ebad67e2b9bc15389/roles/847d13d004f94d888ecf8be41cb07086 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:34:11.150476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde8b03-fa44-4e31-aa83-93e2f7df3500 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:11.190627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283e8b8-0cea-4fe4-9536-423c4e9fdf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:11.191750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283e8b8-0cea-4fe4-9536-423c4e9fdf67 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.192234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283e8b8-0cea-4fe4-9536-423c4e9fdf67 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.192867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283e8b8-0cea-4fe4-9536-423c4e9fdf67 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/694fbff28110406ebad67e2b9bc15389/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.195310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283e8b8-0cea-4fe4-9536-423c4e9fdf67 None admin] RBAC: Authorizing `identity:create_grant(project_id=34274a6be6514c5ab10310901a4b0d84, user_id=694fbff28110406ebad67e2b9bc15389, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:11.197831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283e8b8-0cea-4fe4-9536-423c4e9fdf67 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:11.218795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 110/234] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:10 2022] PUT /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/694fbff28110406ebad67e2b9bc15389/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:11.340327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2f97f-ba2f-49d0-b995-058ffb64c889 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.340930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2f97f-ba2f-49d0-b995-058ffb64c889 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.341409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2f97f-ba2f-49d0-b995-058ffb64c889 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.343412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 125/235] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:11.348999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9c8b-873d-4401-b3f3-f4afa38e1507 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.349334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9c8b-873d-4401-b3f3-f4afa38e1507 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.349552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b9c8b-873d-4401-b3f3-f4afa38e1507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.379140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-387b9c8b-873d-4401-b3f3-f4afa38e1507 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:11.380456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-387b9c8b-873d-4401-b3f3-f4afa38e1507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:11.412478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:11.468635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 111/236] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:11.500060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cae11-6023-46b3-ad28-65433b913a96 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.500583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cae11-6023-46b3-ad28-65433b913a96 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.500583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cae11-6023-46b3-ad28-65433b913a96 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.502248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 126/237] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:11.507980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029f61f-2086-4dda-935e-873b8725250f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.508269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029f61f-2086-4dda-935e-873b8725250f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.508549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f029f61f-2086-4dda-935e-873b8725250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.530452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f029f61f-2086-4dda-935e-873b8725250f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:11.531683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f029f61f-2086-4dda-935e-873b8725250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:11.622041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 112/238] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:11.737412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cae11-6023-46b3-ad28-65433b913a96 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:11.844240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:11.859541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cae11-6023-46b3-ad28-65433b913a96 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:11.902386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:11.903401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:11.903867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:11.904319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:11.923584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:11.928440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:11.929275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:11.930071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 127/239] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:11.935597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029f61f-2086-4dda-935e-873b8725250f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:11.990254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.125078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:12.142734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f029f61f-2086-4dda-935e-873b8725250f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:12.157020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e1c10-38c4-479e-a02b-2bcded33f69c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:12.184903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:12.185889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.186358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.186854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.187808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:12.188343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:12.190001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:12.199156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 113/240] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:12.204876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.215232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5d1e5-87cd-4a48-9dd8-021b2de9a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:12.216892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5d1e5-87cd-4a48-9dd8-021b2de9a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.220454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5d1e5-87cd-4a48-9dd8-021b2de9a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.220924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5d1e5-87cd-4a48-9dd8-021b2de9a6e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.224059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5d1e5-87cd-4a48-9dd8-021b2de9a6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:12.225730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5d1e5-87cd-4a48-9dd8-021b2de9a6e7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:12.227580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 128/241] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:12.235188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fdded-d202-4631-9ee3-40a8b804c285 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.235719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fdded-d202-4631-9ee3-40a8b804c285 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.236240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fdded-d202-4631-9ee3-40a8b804c285 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.237950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 129/242] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:12.238826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fdded-d202-4631-9ee3-40a8b804c285 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.264629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:12.326670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c91804-05f8-4cfc-afec-842d883d3ba5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:12.347196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fdded-d202-4631-9ee3-40a8b804c285 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:12.362829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe62e3f-24d6-44f2-89c1-7e85f048004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:12.363456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62e3f-24d6-44f2-89c1-7e85f048004e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.363730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62e3f-24d6-44f2-89c1-7e85f048004e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.363999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62e3f-24d6-44f2-89c1-7e85f048004e None admin] PATH_INFO: `/v3/users/ea969ba74c7541d6a3924d0ba3856d81` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.377706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe62e3f-24d6-44f2-89c1-7e85f048004e None admin] RBAC: Authorizing `identity:get_user(user_id=ea969ba74c7541d6a3924d0ba3856d81)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:12.379184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe62e3f-24d6-44f2-89c1-7e85f048004e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:12.381497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 114/243] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:12 2022] GET /identity/v3/users/ea969ba74c7541d6a3924d0ba3856d81 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:12.382815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.383092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.383330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:12.383445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.384262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.384727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.385238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.386448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:12.388322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:12.390553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:12.403292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:12.404593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:12.413242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 130/244] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:12 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:12.414416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.477164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 115/245] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:12.506514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:12.532339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88306d-83a1-444c-b8b4-aed24455e3ec None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:12.569932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:12.570573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.570888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.571159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.646528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:12.648171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:12.726489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:12.750454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 131/246] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:12.755763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.860073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c2a90-2274-4e28-a51f-3a8534247b4e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:12.874256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.897764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:12.898400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:12.898694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:12.898967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:12.900084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:12.901518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:12.903463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 116/247] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:12 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:12.909212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:12.913706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:12.986584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad15a61-e4db-498a-97dc-b4ceedfaf9e6 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:13.024368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:13.025065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.025342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.025607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.027017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b6c8d-fe61-478a-ac9c-f12de0646e16 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:13.038239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:13.043546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:13.044513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:13.045286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 132/248] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:13.054529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:13.071691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:13.072645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.073140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.073606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.074556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] RBAC: Adding query filter params (role.id=93b8aa5cf7004027892f201f9b873be1, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=ea969ba74c7541d6a3924d0ba3856d81) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:13.075088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:13.076726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:13.083358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 117/249] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:12 2022] GET /identity/v3/role_assignments?user.id=ea969ba74c7541d6a3924d0ba3856d81&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=93b8aa5cf7004027892f201f9b873be1 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:13.099356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:13.168303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605d60e-2972-44e2-af4f-a0d2c031648d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:13.206717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:13.207343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.207622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.207886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.208626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:13.208923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:13.210354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:13.220239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 133/250] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:13.227293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:13.304454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:13.341631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ef1a7-543b-45d2-a9ff-92b85027cc0f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:13.376840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d11ffd-3ee5-4494-8e64-47b36aa2213a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:13.377494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11ffd-3ee5-4494-8e64-47b36aa2213a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.377839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11ffd-3ee5-4494-8e64-47b36aa2213a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.378116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d11ffd-3ee5-4494-8e64-47b36aa2213a None admin] PATH_INFO: `/v3/users/2146477bc2d741578db01042f5145cdc` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.379332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11ffd-3ee5-4494-8e64-47b36aa2213a None admin] RBAC: Authorizing `identity:get_user(user_id=2146477bc2d741578db01042f5145cdc)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:13.380894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d11ffd-3ee5-4494-8e64-47b36aa2213a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:13.382826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 118/251] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:13 2022] GET /identity/v3/users/2146477bc2d741578db01042f5145cdc => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:13.388430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:13.472939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13582-8bb4-4edb-a9aa-71595ce0ec82 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.473239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13582-8bb4-4edb-a9aa-71595ce0ec82 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.473869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae13582-8bb4-4edb-a9aa-71595ce0ec82 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.475860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 119/252] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:13.481285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182c355-40fc-46b4-b4c2-d480d8fbf01f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.481571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182c355-40fc-46b4-b4c2-d480d8fbf01f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.481846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182c355-40fc-46b4-b4c2-d480d8fbf01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.495915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:13.499188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280255ff-4e01-4224-8133-82fa2ab6c87e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:13.502865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f182c355-40fc-46b4-b4c2-d480d8fbf01f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:13.504064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f182c355-40fc-46b4-b4c2-d480d8fbf01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:13.539093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:13.539730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.540010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.540283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.541415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:13.542924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:13.545385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 134/253] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:13 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:13.557627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:13.582230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 120/254] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:13.596228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a485-c001-4c07-9a2a-7be28cdcfacd None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.596542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a485-c001-4c07-9a2a-7be28cdcfacd None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.596783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123a485-c001-4c07-9a2a-7be28cdcfacd None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.598266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 121/255] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:13.604454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.604735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.605011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.643749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:13.645020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:13.665886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd4e5d-7973-4a33-bf68-f4ebc2fb6ddb None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:13.729374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:13.730142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:13.730424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:13.730712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/2146477bc2d741578db01042f5145cdc/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:13.735042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:13.736605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] RBAC: Authorizing `identity:create_grant(project_id=34274a6be6514c5ab10310901a4b0d84, user_id=2146477bc2d741578db01042f5145cdc, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:13.738062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:13.748289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 122/256] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:13.781729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 135/257] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:13 2022] PUT /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/2146477bc2d741578db01042f5145cdc/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:34:13.962670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.069591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd8c5f-dc06-4997-a957-700db2a7be1d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.105055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:14.105692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:14.105975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:14.106251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:14.117465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:14.122259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:14.124242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:14.126113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 123/258] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:14.129684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.171439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:14.240971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f040ab0-b9fc-4995-b18a-2905b7c61a3f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.275546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:14.276170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:14.276450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:14.276726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:14.277400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:14.277704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:14.279279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:14.288451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 136/259] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:14.293992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.305042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.425207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:14.441954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:14.453294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cf215-f306-4dae-a8d0-668b18c583c4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.497930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:14.498595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:14.498916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:14.499192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:14.521738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:14.535969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:14.536994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:14.538235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 137/260] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:14.547221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.591210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a21b2f-2ff8-4917-9d04-184f3785db46 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.675479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd7ef-9960-44c2-8760-d169b7647894 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.714142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:14.714784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:14.715195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:14.715472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:14.716145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:14.716450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:14.717912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:14.727277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 138/261] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:14.736001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.739420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:14.740068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:14.740342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:14.740606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] PATH_INFO: `/v3/users/694fbff28110406ebad67e2b9bc15389` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:14.741858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] RBAC: Authorizing `identity:get_user(user_id=694fbff28110406ebad67e2b9bc15389)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:14.743383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:14.745268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 124/262] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:14 2022] GET /identity/v3/users/694fbff28110406ebad67e2b9bc15389 => generated 283 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:14.750500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:14.756398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:14.918044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed755-4e4b-4ba0-9b65-c1c4e97eaeb4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.924749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde62c3-eb9c-44de-bc28-ec574f42eeda None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:14.941644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:14.968181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:14.968813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:14.969091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:14.969363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.006891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:15.007453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.007724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.007990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] PATH_INFO: `/v3/users/694fbff28110406ebad67e2b9bc15389` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.009486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] RBAC: Authorizing `identity:get_user(user_id=694fbff28110406ebad67e2b9bc15389)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:15.010964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:15.012534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 139/263] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:14 2022] GET /identity/v3/users/694fbff28110406ebad67e2b9bc15389 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:15.023633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:15.119148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:15.120633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:15.127175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:15.167584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a0944-eb5f-4e73-b2e8-ada54a47505e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:15.252307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:15.252927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.253201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.253467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.321234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 125/264] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:15.326869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:15.358848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:15.424878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:15.426349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:15.443333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa421e-41fa-49a7-8902-ccc8c246b89a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:15.478492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:15.479243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.479531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.479806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.481048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:15.482528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:15.484530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 126/265] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:15 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:15.495640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:15.628069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:15.646119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:15.658345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530777f6-cf1a-4381-8bf9-588a8e837b67 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:15.695412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:15.696371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.696834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.697435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.698387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=694fbff28110406ebad67e2b9bc15389) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:15.698917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:15.700541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df18f3-22a4-4dde-8afe-19dc63bc292a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:15.705619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 140/266] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:15.707296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 127/267] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:15 2022] GET /identity/v3/role_assignments?user.id=694fbff28110406ebad67e2b9bc15389&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:15.710809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:15.845372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524fc11-d631-4593-a610-86ac2d2d5f59 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:15.890534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5c607-87ac-4067-9af4-b6b089d080ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:15.891562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c607-87ac-4067-9af4-b6b089d080ad None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.892048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c607-87ac-4067-9af4-b6b089d080ad None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.892503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5c607-87ac-4067-9af4-b6b089d080ad None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.893823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5c607-87ac-4067-9af4-b6b089d080ad None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:15.895531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5c607-87ac-4067-9af4-b6b089d080ad None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:15.898999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784117d-3598-4e91-a655-a294ee45ffa1 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.899521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784117d-3598-4e91-a655-a294ee45ffa1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.899979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784117d-3598-4e91-a655-a294ee45ffa1 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.901483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 128/268] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:15.901913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 141/269] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:15 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:15.902831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784117d-3598-4e91-a655-a294ee45ffa1 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:15.924673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446569e6-ceb7-40e8-8164-f879d7a17fb1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:15.925363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446569e6-ceb7-40e8-8164-f879d7a17fb1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:15.925823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446569e6-ceb7-40e8-8164-f879d7a17fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:15.955924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-446569e6-ceb7-40e8-8164-f879d7a17fb1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:15.959949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-446569e6-ceb7-40e8-8164-f879d7a17fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:16.015199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:16.039386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 142/270] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:16.040707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2046b7-1b6d-456a-895e-0b48e1c532fc None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.041140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2046b7-1b6d-456a-895e-0b48e1c532fc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.041542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2046b7-1b6d-456a-895e-0b48e1c532fc None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.043258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 143/271] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:16.049050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aec96e-840c-4c4f-b40c-5b994782c047 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.049645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aec96e-840c-4c4f-b40c-5b994782c047 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.051225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aec96e-840c-4c4f-b40c-5b994782c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.070052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-47aec96e-840c-4c4f-b40c-5b994782c047 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:16.070270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784117d-3598-4e91-a655-a294ee45ffa1 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.071612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-47aec96e-840c-4c4f-b40c-5b994782c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:16.117466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.118261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.118547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.118858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.119616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] RBAC: Adding query filter params (role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=694fbff28110406ebad67e2b9bc15389) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:16.120148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:16.121551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f725570-6029-460c-8381-4f9d5f63096d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:16.128229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 129/272] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:15 2022] GET /identity/v3/role_assignments?user.id=694fbff28110406ebad67e2b9bc15389&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=847d13d004f94d888ecf8be41cb07086 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:16.148067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 144/273] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:16.191240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764134ea-35b2-4181-bcaf-173b91de47ce None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.191759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764134ea-35b2-4181-bcaf-173b91de47ce None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.192173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764134ea-35b2-4181-bcaf-173b91de47ce None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.194157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 130/274] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:16.199667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.199945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.200376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.226705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:16.228479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:16.313167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 145/275] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:16.354823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764134ea-35b2-4181-bcaf-173b91de47ce None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.375709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:16.470778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.479373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764134ea-35b2-4181-bcaf-173b91de47ce None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.510348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:16.519905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.520821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.521238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.521644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.535050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:16.540139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:16.541196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:16.542152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:16.544508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 131/276] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:16.550439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.596385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9755a8-27cd-421b-9d03-2ce91fe9252e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.633411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.634769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.635187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.635453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.646853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:16.651903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:16.652839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:16.653648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:16.654300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:16.656107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 146/277] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:16.657057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.679210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf34594-13f2-4a92-8077-39123f878ecd None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.713183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.713798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.714057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.714322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.715013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:16.715310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:16.716691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:16.726075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 132/278] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:16.726895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.770373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:16.776856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9412d-50e0-4869-bde9-7f8216d33fc9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.809361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.809982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.810251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.810514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.811628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:16.813083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:16.814795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 147/279] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:16.815387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.830470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32596f7-06da-4ab9-9a02-3b644a42d2f3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.863977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.864617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.864906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.865170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.865837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:16.866136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:16.867543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39c5cb-1fe7-496b-acb0-a57a57247719 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:16.875604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 133/280] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:16.876776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894cc6-bf95-495c-8115-feacdeb419d5 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.877056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894cc6-bf95-495c-8115-feacdeb419d5 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.877332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894cc6-bf95-495c-8115-feacdeb419d5 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.878543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 134/281] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:16.879319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c894cc6-bf95-495c-8115-feacdeb419d5 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.881984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:16.922435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440f958-529b-4ec2-bc9e-0bdaae18f0d2 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.955024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:16.955651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:16.955923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:16.956191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] PATH_INFO: `/v3/users/ea969ba74c7541d6a3924d0ba3856d81` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:16.957358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea969ba74c7541d6a3924d0ba3856d81)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:16.958922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:16.964961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 148/282] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/users/ea969ba74c7541d6a3924d0ba3856d81 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:16.964961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:16.988674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c894cc6-bf95-495c-8115-feacdeb419d5 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:16.993708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:17.024677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2f9f-1d8b-4a55-bb7c-9c2ffdcdeef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.025299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2f9f-1d8b-4a55-bb7c-9c2ffdcdeef6 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.025574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2f9f-1d8b-4a55-bb7c-9c2ffdcdeef6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.025830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2f9f-1d8b-4a55-bb7c-9c2ffdcdeef6 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.026501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2f9f-1d8b-4a55-bb7c-9c2ffdcdeef6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:17.028019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2f9f-1d8b-4a55-bb7c-9c2ffdcdeef6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:17.051187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 135/283] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:16 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:17.052297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.052583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.052854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.068956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d136a-cffd-41dc-b421-1abc0bad86a3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.082353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:17.084026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:17.107966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.108586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.108855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.109116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] PATH_INFO: `/v3/users/c18b1edec30d471b922ea08450ff5edf` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.124042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] RBAC: Authorizing `identity:get_user(user_id=c18b1edec30d471b922ea08450ff5edf)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:17.125525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:17.132485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 149/284] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:16 2022] GET /identity/v3/users/c18b1edec30d471b922ea08450ff5edf => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:17.132485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:17.155925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:17.175770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 136/285] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:17.176967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:17.232189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:17.251976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197ba53-b089-4347-aee6-b53d4c52debd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.308851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.309823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.310277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.310826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.312186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:17.313850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:17.316128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 150/286] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:17 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:17.317601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406b33f-a2d4-4fab-86be-3514b78f7d54 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.323916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:17.373232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.373878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.374123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.374389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.375161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, user.id=c18b1edec30d471b922ea08450ff5edf, scope.system=all) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:17.375462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:17.376903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:17.382613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 137/287] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 10:34:17 2022] GET /identity/v3/role_assignments?user.id=c18b1edec30d471b922ea08450ff5edf&scope.system=all&role.id=4dfba98327a94751bce3982770d6465f => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:17.449912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc656119-503c-4a74-9f1b-f4978def2ca5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.460135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:17.501649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.502836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.503311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.503768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/ea969ba74c7541d6a3924d0ba3856d81/roles/93b8aa5cf7004027892f201f9b873be1` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.506098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] RBAC: Authorizing `identity:create_grant(project_id=34274a6be6514c5ab10310901a4b0d84, user_id=ea969ba74c7541d6a3924d0ba3856d81, role_id=93b8aa5cf7004027892f201f9b873be1)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:17.507970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:17.526432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:17.541031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 151/288] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:17 2022] PUT /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84/users/ea969ba74c7541d6a3924d0ba3856d81/roles/93b8aa5cf7004027892f201f9b873be1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:17.594362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc33b-dd02-4fc9-af33-006cefaeffcb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.633197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.634196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.634667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.635125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.647555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:17.653430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:17.654381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:17.655196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:17.657659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 138/289] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:17.663312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:17.689468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:17.796851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01b6b9-427e-43f6-ae5e-8d3dc434615d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.830771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:17.831387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:17.831659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:17.831967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:17.832641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:17.832977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:17.834341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:17.845006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 152/290] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:17.850671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:17.972520 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc344e12-e2de-4012-9265-e12d208422ae None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:17.988397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:18.011808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:18.012438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:18.012713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:18.012979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] PATH_INFO: `/v3/users/2146477bc2d741578db01042f5145cdc` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:18.014109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] RBAC: Authorizing `identity:get_user(user_id=2146477bc2d741578db01042f5145cdc)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:18.015901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:18.017772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 139/291] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:17 2022] GET /identity/v3/users/2146477bc2d741578db01042f5145cdc => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:18.023652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:18.112346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:18.131708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cbfec-584e-4c77-b3b4-8540648ecb15 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:18.165992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:18.166604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:18.166915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:18.167184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:18.244332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:18.245867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:18.334637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:18.364350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 153/292] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:18.369792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:18.509315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe877980-7cc1-4109-a228-94b96c175e09 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:18.549651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476d2e0-43c5-48ab-9999-37b94f775049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:18.550285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d2e0-43c5-48ab-9999-37b94f775049 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:18.550565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d2e0-43c5-48ab-9999-37b94f775049 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:18.550868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476d2e0-43c5-48ab-9999-37b94f775049 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:18.552117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d2e0-43c5-48ab-9999-37b94f775049 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:18.553580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476d2e0-43c5-48ab-9999-37b94f775049 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:18.555607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 140/293] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:18 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:18.561251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:18.699477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb094b6-8091-449d-a9bb-cb0dd177ca0b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:18.744406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:18.745035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:18.745311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:18.745576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:18.746325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=2146477bc2d741578db01042f5145cdc) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:18.746629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:18.748155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb02250-dc32-4f1e-b099-2833d453864a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:18.758799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 154/294] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:18 2022] GET /identity/v3/role_assignments?user.id=2146477bc2d741578db01042f5145cdc&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=4dfba98327a94751bce3982770d6465f => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:19.601291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091601-bca0-4a43-8f89-fcae542b7910 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.601811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091601-bca0-4a43-8f89-fcae542b7910 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.601811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091601-bca0-4a43-8f89-fcae542b7910 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.603445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 141/295] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:19.608821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7133f8-2bb9-4210-905d-238a98b9abde None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.609111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7133f8-2bb9-4210-905d-238a98b9abde None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.609384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7133f8-2bb9-4210-905d-238a98b9abde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.612667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6fb7-7915-4666-9f98-a86f89d87b51 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.612950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6fb7-7915-4666-9f98-a86f89d87b51 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.613224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6fb7-7915-4666-9f98-a86f89d87b51 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.614872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 142/296] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:19.620117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78644a98-9c93-4f44-96f8-5c46365d6a93 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.620400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78644a98-9c93-4f44-96f8-5c46365d6a93 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.620681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78644a98-9c93-4f44-96f8-5c46365d6a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.629601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2e7133f8-2bb9-4210-905d-238a98b9abde None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:19.631794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2e7133f8-2bb9-4210-905d-238a98b9abde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:19.641010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-78644a98-9c93-4f44-96f8-5c46365d6a93 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:19.642696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-78644a98-9c93-4f44-96f8-5c46365d6a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:19.675234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:19.698219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:19.704563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 155/297] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:19.705642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc47a5-ada6-484b-bfdc-6e2b40a8cdc8 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.705925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc47a5-ada6-484b-bfdc-6e2b40a8cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.706196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc47a5-ada6-484b-bfdc-6e2b40a8cdc8 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.707608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 156/298] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:19.712808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc689-24af-4449-a0da-bbab87da14bb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.713075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc689-24af-4449-a0da-bbab87da14bb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.713407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc689-24af-4449-a0da-bbab87da14bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.735087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e13dc689-24af-4449-a0da-bbab87da14bb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:19.736360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 143/299] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:19.738990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e13dc689-24af-4449-a0da-bbab87da14bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:19.807489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 157/300] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:19.930116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b04b-ae7d-41df-9b48-e4f93c1e4154 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.930407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b04b-ae7d-41df-9b48-e4f93c1e4154 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.930567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7b04b-ae7d-41df-9b48-e4f93c1e4154 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.932219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 144/301] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:19.937261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:19.937543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:19.937810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:19.955999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:19.957175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:19.972179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b04b-ae7d-41df-9b48-e4f93c1e4154 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.046867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 158/302] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:20.051629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.085155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7b04b-ae7d-41df-9b48-e4f93c1e4154 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.094317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.121850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.122722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.123004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.123269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.133437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:20.138143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:20.139172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:20.140451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:20.144476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 145/303] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:20.145348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.167992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa66c5-d3d4-4c35-8f8d-108e705c01d6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.184714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.204846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.205684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.206097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.206537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.216579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:20.221421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:20.222489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:20.223555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:20.225443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 159/304] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:20.226351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.250259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb90e4-da74-4c24-8e76-eacbd474cf7b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.287971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.288611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.288889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.289160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.290315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.291826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.293412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 146/305] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:20.294172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.325723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.333221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3bcb-4dc5-4737-bb28-d9268b5d82ff None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.365945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.366547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.366869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.367138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.367801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:20.368101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.369488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.377317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 160/306] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:20.378072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.403488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74dd11-a44e-43a1-bdb4-e31c8336e451 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.410495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.437497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.438034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.438310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.438587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.439305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:20.439609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.441012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.449217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 147/307] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:20.450516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.474310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664dda3-8f22-416e-8498-ca814f9572e8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.506460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.507102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.507375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.507643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] PATH_INFO: `/v3/groups` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.508246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.509689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.526635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 161/308] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Aug 12 10:34:20 2022] POST /identity/v3/groups => generated 229 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:20.527672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.553908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679585-4e76-47e1-af6a-267c522b1079 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.557061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.594095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.594802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.595079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.595353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.607698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:20.612988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:20.613919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:20.614799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 148/309] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:20.615858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.652550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1410e-735f-4120-a076-c8057555c387 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.657415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.691686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.692233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.692509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.692775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] PATH_INFO: `/v3/users/c18b1edec30d471b922ea08450ff5edf` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.693887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] RBAC: Authorizing `identity:get_user(user_id=c18b1edec30d471b922ea08450ff5edf)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.695359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.696918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 162/310] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/users/c18b1edec30d471b922ea08450ff5edf => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:20.697670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.739831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939439e8-0a23-4b50-978d-27d43cb05ae4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.779367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.780002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.780273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.780548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] PATH_INFO: `/v3/users/f3fa699d653a464890ef8769d3234b99` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.786306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.794991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] RBAC: Authorizing `identity:get_user(user_id=f3fa699d653a464890ef8769d3234b99)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.796528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.798189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 149/311] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/users/f3fa699d653a464890ef8769d3234b99 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:20.798956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.811337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aae97c-7eee-41b9-a0c2-310cef024416 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.844751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.845358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.845652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.845898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.846618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:20.846945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.848343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.856912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 163/312] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:20.861945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.892652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:20.909425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf198de-c2d3-47b0-a8f8-5f614b5eedca None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:20.946554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:20.947143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:20.947419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:20.947701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] PATH_INFO: `/v3/system/users/c18b1edec30d471b922ea08450ff5edf/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:20.949085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c18b1edec30d471b922ea08450ff5edf, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:20.950454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:20.960487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 150/313] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Aug 12 10:34:20 2022] PUT /identity/v3/system/users/c18b1edec30d471b922ea08450ff5edf/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:20.961322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:20.976045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac006ced-f01c-46cb-bc05-332736d11fc1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:21.019270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:21.019900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:21.020344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:21.020597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:21.021349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] RBAC: Adding query filter params (role.id=93b8aa5cf7004027892f201f9b873be1, user.id=f3fa699d653a464890ef8769d3234b99, scope.system=all) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:21.021661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:21.023216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:21.029237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 164/314] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/role_assignments?user.id=f3fa699d653a464890ef8769d3234b99&scope.system=all&role.id=93b8aa5cf7004027892f201f9b873be1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:21.104293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad830e-84b2-4482-abf0-c450eeef4857 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:21.144580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:21.145234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:21.145562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:21.145831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] PATH_INFO: `/v3/users/ea969ba74c7541d6a3924d0ba3856d81` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:21.147128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] RBAC: Authorizing `identity:get_user(user_id=ea969ba74c7541d6a3924d0ba3856d81)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:21.148625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:21.150532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 151/315] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:20 2022] GET /identity/v3/users/ea969ba74c7541d6a3924d0ba3856d81 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:21.156659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:21.171715 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:21.263355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0452-0fe8-4063-aa7c-f881d2127ee4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:21.297466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:21.298410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:21.298916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:21.299372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:21.371788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:21.373603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:21.385047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:21.472905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 165/316] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:21.478406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:21.502645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:21.590352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a56b1e-929d-46ad-b9ce-1299fa2f3dbb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:21.624303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3fe1b-0f49-4cd3-85eb-0730c1080822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:21.624914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fe1b-0f49-4cd3-85eb-0730c1080822 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:21.625194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fe1b-0f49-4cd3-85eb-0730c1080822 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:21.625460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3fe1b-0f49-4cd3-85eb-0730c1080822 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:21.626574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fe1b-0f49-4cd3-85eb-0730c1080822 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:21.628039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3fe1b-0f49-4cd3-85eb-0730c1080822 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:21.630128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 152/317] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:21 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:21.636276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:21.736463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca731e-c8c2-436b-b4b8-b8853e75f7ab None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:21.746990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:21.770767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:21.771367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:21.771640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:21.771907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:21.772626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] RBAC: Adding query filter params (role.id=93b8aa5cf7004027892f201f9b873be1, scope.project.id=34274a6be6514c5ab10310901a4b0d84, user.id=ea969ba74c7541d6a3924d0ba3856d81) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:21.772933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:21.774370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3684d6-a36e-4628-a3cb-9e33a093f339 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:21.780470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 166/318] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:21 2022] GET /identity/v3/role_assignments?user.id=ea969ba74c7541d6a3924d0ba3856d81&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=93b8aa5cf7004027892f201f9b873be1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:22.486310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61d8d-db7b-44fb-9a11-65f271577869 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:22.486762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61d8d-db7b-44fb-9a11-65f271577869 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:22.486960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f61d8d-db7b-44fb-9a11-65f271577869 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:22.488384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 153/319] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:22.493712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077640c-3965-4850-b0b4-dd4dd1b99bd9 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:22.494161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077640c-3965-4850-b0b4-dd4dd1b99bd9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:22.494258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077640c-3965-4850-b0b4-dd4dd1b99bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:22.513095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9077640c-3965-4850-b0b4-dd4dd1b99bd9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:22.514301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9077640c-3965-4850-b0b4-dd4dd1b99bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:22.588606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 167/320] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:22.852938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61d8d-db7b-44fb-9a11-65f271577869 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:22.917275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01b216-6a02-49ea-9420-7d1abbe52c10 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:22.917594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01b216-6a02-49ea-9420-7d1abbe52c10 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:22.917827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01b216-6a02-49ea-9420-7d1abbe52c10 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:22.919208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 168/321] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:22.924405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c31d0b-3ac1-454a-8875-c2676024f1b5 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:22.924937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c31d0b-3ac1-454a-8875-c2676024f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:22.925715 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c31d0b-3ac1-454a-8875-c2676024f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:22.943249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-00c31d0b-3ac1-454a-8875-c2676024f1b5 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:22.944055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:22.944433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-00c31d0b-3ac1-454a-8875-c2676024f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:22.959745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f61d8d-db7b-44fb-9a11-65f271577869 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:22.993770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcaa09-c1c4-4698-af37-7e87a331ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:22.994396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcaa09-c1c4-4698-af37-7e87a331ec3b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:22.994670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcaa09-c1c4-4698-af37-7e87a331ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:22.994952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcaa09-c1c4-4698-af37-7e87a331ec3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:22.996027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcaa09-c1c4-4698-af37-7e87a331ec3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:22.997444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcaa09-c1c4-4698-af37-7e87a331ec3b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:22.999077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 154/322] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:23.001258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba4679-9d3d-4050-a80a-9337bce1cfdd None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.001526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba4679-9d3d-4050-a80a-9337bce1cfdd None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.001802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba4679-9d3d-4050-a80a-9337bce1cfdd None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.003070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 155/323] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:23.003070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba4679-9d3d-4050-a80a-9337bce1cfdd None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.016608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 169/324] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:23.017849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.018134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.018405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.041603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:23.043076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:23.070723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:23.112909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 170/325] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:23.113811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba4679-9d3d-4050-a80a-9337bce1cfdd None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.148714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.149336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.149653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.149958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] PATH_INFO: `/v3/groups` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.150607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:23.152095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:23.171037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 156/326] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Aug 12 10:34:23 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:34:23.280338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.381024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.392824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff6f10-8074-4800-a985-4851593ff597 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.401898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:23.439827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.440706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.441122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.442432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.457492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:23.462993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:23.463904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:23.464723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 171/327] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:23.470165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.503750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:23.518794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f7bb5-6452-40d7-affd-6a8cb33eabb3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.557967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.558612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.558935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.559209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.571140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:23.575892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:23.576926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:23.577937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 157/328] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:23.583400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.595503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca366f0-f86d-460a-946c-3a888d35cc3c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.647708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.648247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.648523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.648793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.649567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:23.649920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:23.651805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:23.661914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 172/329] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:23.667668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.678001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:23.712240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489bce-4ec4-48ec-a34b-6394fc69e4e9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.757951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.759026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.759532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.760095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.761436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:23.761889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:23.763799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:23.778673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 158/330] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:23.784516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.786891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:23.814723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b5d04-0a59-42ed-9289-5de53207b436 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.861239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.861905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.862195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.862884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] PATH_INFO: `/v3/users/c18b1edec30d471b922ea08450ff5edf` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.864321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] RBAC: Authorizing `identity:get_user(user_id=c18b1edec30d471b922ea08450ff5edf)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:23.866404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:23.868881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 173/331] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/users/c18b1edec30d471b922ea08450ff5edf => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:23.875089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.916454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59603ae-a072-4130-8fde-ab6604975de1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:23.961295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:23.962028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:23.962233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:23.962498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] PATH_INFO: `/v3/users/f3fa699d653a464890ef8769d3234b99` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:23.964101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] RBAC: Authorizing `identity:get_user(user_id=f3fa699d653a464890ef8769d3234b99)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:23.965150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:23.966778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 159/332] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/users/f3fa699d653a464890ef8769d3234b99 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:23.975494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:23.980243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:24.012171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11bb5a-05b3-4519-952d-e79013dc0259 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:24.055899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4747-5800-422e-902e-50e81304a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:24.056552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4747-5800-422e-902e-50e81304a146 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:24.056834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4747-5800-422e-902e-50e81304a146 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:24.057112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4747-5800-422e-902e-50e81304a146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:24.057863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4747-5800-422e-902e-50e81304a146 None admin] RBAC: Adding query filter params (role.id=4dfba98327a94751bce3982770d6465f, user.id=c18b1edec30d471b922ea08450ff5edf, scope.system=all) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:24.058173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4747-5800-422e-902e-50e81304a146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:24.059757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4747-5800-422e-902e-50e81304a146 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:24.075311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 174/333] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 10:34:23 2022] GET /identity/v3/role_assignments?user.id=c18b1edec30d471b922ea08450ff5edf&scope.system=all&role.id=4dfba98327a94751bce3982770d6465f => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:24.103118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0d7a5-721a-40ab-b191-70479e9a3114 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:24.157137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb08c1b-495a-4c53-881f-6e717966c319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:24.157825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08c1b-495a-4c53-881f-6e717966c319 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:24.158112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08c1b-495a-4c53-881f-6e717966c319 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:24.158385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb08c1b-495a-4c53-881f-6e717966c319 None admin] PATH_INFO: `/v3/system/users/f3fa699d653a464890ef8769d3234b99/roles/93b8aa5cf7004027892f201f9b873be1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:24.159975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08c1b-495a-4c53-881f-6e717966c319 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f3fa699d653a464890ef8769d3234b99, role_id=93b8aa5cf7004027892f201f9b873be1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:24.161472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb08c1b-495a-4c53-881f-6e717966c319 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:24.179499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 160/334] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Aug 12 10:34:23 2022] PUT /identity/v3/system/users/f3fa699d653a464890ef8769d3234b99/roles/93b8aa5cf7004027892f201f9b873be1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:25.450283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c71d-17d5-4605-ab1d-1d4e8cca3db5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:25.450868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c71d-17d5-4605-ab1d-1d4e8cca3db5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:25.450962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9c71d-17d5-4605-ab1d-1d4e8cca3db5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:25.452519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 175/335] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:25.462958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1fa5-e3e4-4bde-b56d-9fb15dc7d89d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:25.463441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1fa5-e3e4-4bde-b56d-9fb15dc7d89d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:25.463537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1fa5-e3e4-4bde-b56d-9fb15dc7d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:25.492034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2d0f1fa5-e3e4-4bde-b56d-9fb15dc7d89d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:25.493249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2d0f1fa5-e3e4-4bde-b56d-9fb15dc7d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:25.579096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:25.587033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 161/336] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:25.739824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5825-1894-49ea-b80f-fb383371f7d3 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:25.740113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5825-1894-49ea-b80f-fb383371f7d3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:25.740295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5825-1894-49ea-b80f-fb383371f7d3 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:25.741897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 176/337] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:25.750591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:25.751154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:25.751620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:25.771143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:25.772645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:25.841186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 162/338] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:25.960487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5825-1894-49ea-b80f-fb383371f7d3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:25.992918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:26.091436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5825-1894-49ea-b80f-fb383371f7d3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:26.131483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:26.132117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.132393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.132666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.147520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:26.153004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:26.153864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:26.154631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:26.157254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 177/339] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:26.163112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:26.312887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777d88-26e9-4437-bf19-ce7e9f624f4a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:26.347241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:26.353985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:26.354615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.354980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.355464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.356211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:26.356665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:26.358235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:26.369300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 163/340] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:26.372972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:26.438895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:26.487718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:26.545448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4740e-a3ff-4f2f-a96e-d2e2e38c1d6c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:26.550189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5eb05-3cb5-435d-be8c-641f26608aa8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:26.590629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fa5ba-45e4-48f9-a2af-0961c77b9ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:26.591274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa5ba-45e4-48f9-a2af-0961c77b9ab0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.591557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa5ba-45e4-48f9-a2af-0961c77b9ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.591831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fa5ba-45e4-48f9-a2af-0961c77b9ab0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.609444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fa5ba-45e4-48f9-a2af-0961c77b9ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:26.614620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6689c13-a593-44ea-b47a-be5f825219dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:26.615283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6689c13-a593-44ea-b47a-be5f825219dd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.615561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6689c13-a593-44ea-b47a-be5f825219dd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.615830 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6689c13-a593-44ea-b47a-be5f825219dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-f60fa5ba-45e4-48f9-a2af-0961c77b9ab0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:26.620351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:26.622323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 164/341] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:26.624208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa52f-6647-485a-816c-b64edee1c2a2 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.626108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa52f-6647-485a-816c-b64edee1c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.626108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220fa52f-6647-485a-816c-b64edee1c2a2 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.626108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 165/342] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:26.636485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa52f-6647-485a-816c-b64edee1c2a2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:26.707331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:26.734088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6689c13-a593-44ea-b47a-be5f825219dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:26.735614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6689c13-a593-44ea-b47a-be5f825219dd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:26.762471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220fa52f-6647-485a-816c-b64edee1c2a2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:26.798652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:26.799289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.799567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.799844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.800513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:26.800815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:26.802248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e9954-9c60-4a10-9200-bcc825b8c20d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:26.811352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 166/343] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:26.812593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf170854-8933-45d3-9094-6572c0543236 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.812878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf170854-8933-45d3-9094-6572c0543236 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.813154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf170854-8933-45d3-9094-6572c0543236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.820720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:26.837164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cf170854-8933-45d3-9094-6572c0543236 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:26.838365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cf170854-8933-45d3-9094-6572c0543236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:26.852167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 178/344] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:34:26.854671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1a175-66f1-4b4f-a68a-d88c163a95b5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:26.855279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1a175-66f1-4b4f-a68a-d88c163a95b5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:26.855790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1a175-66f1-4b4f-a68a-d88c163a95b5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:26.861399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 179/345] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:26.862556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1a175-66f1-4b4f-a68a-d88c163a95b5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:26.920586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 167/346] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:26.921752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf170854-8933-45d3-9094-6572c0543236 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.017193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:27.041713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1a175-66f1-4b4f-a68a-d88c163a95b5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.108346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.109495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.111221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.111689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.131353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf170854-8933-45d3-9094-6572c0543236 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.191073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:27.193255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486086d5-7fab-4651-9f23-99644abd4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.195540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486086d5-7fab-4651-9f23-99644abd4492 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.196023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486086d5-7fab-4651-9f23-99644abd4492 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.196981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486086d5-7fab-4651-9f23-99644abd4492 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.198793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486086d5-7fab-4651-9f23-99644abd4492 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:27.201465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486086d5-7fab-4651-9f23-99644abd4492 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:27.205813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 168/347] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:26 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:27.209426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.210879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.211353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.241620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:27.243504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:27.249216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:27.255699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:27.343099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 169/348] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:27.344337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.379895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 180/349] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:27.382034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.395783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:27.461922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1e6b3-5a66-452f-a9f2-530a89f886aa None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.495046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:27.497634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e1e1-00fc-4f7f-bef6-ed151a0abf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.498373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e1e1-00fc-4f7f-bef6-ed151a0abf1b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.498737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e1e1-00fc-4f7f-bef6-ed151a0abf1b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.499067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e1e1-00fc-4f7f-bef6-ed151a0abf1b None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.505393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7e1e1-00fc-4f7f-bef6-ed151a0abf1b None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:27.506952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7e1e1-00fc-4f7f-bef6-ed151a0abf1b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:27.509607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 170/350] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:27.509960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333b285-26d6-46a1-b627-bcf672233d70 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.510953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76316590-22a9-4338-af3a-0e19462545d7 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.511290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76316590-22a9-4338-af3a-0e19462545d7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.511687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76316590-22a9-4338-af3a-0e19462545d7 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.513240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 171/351] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:27.514005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76316590-22a9-4338-af3a-0e19462545d7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.555837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264ccf3-d708-42e5-a959-c884ec51d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.556542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264ccf3-d708-42e5-a959-c884ec51d497 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.556825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264ccf3-d708-42e5-a959-c884ec51d497 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.557101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264ccf3-d708-42e5-a959-c884ec51d497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.576795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264ccf3-d708-42e5-a959-c884ec51d497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a264ccf3-d708-42e5-a959-c884ec51d497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:27.582672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:27.583617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:27.584433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 181/352] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:27.585637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.585794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.586032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.611552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:27.612873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:27.626634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76316590-22a9-4338-af3a-0e19462545d7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.629425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:27.663889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.664435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.664711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.664982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.666111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:27.667629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:27.669422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 172/353] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:27.670096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.708481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 182/354] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:27.708481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.786710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:27.801063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b887933-22ee-4131-8bde-38b3412499ae None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.839367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21492a02-552d-48d0-9760-597f16448fc7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:27.847962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.848686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.848969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.849787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.850550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:27.850950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:27.852887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:27.860915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 173/355] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=4dfba98327a94751bce3982770d6465f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:27.861918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.883549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:27.884183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:27.884460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:27.884731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:27.885420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:27.885726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:27.887217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:27.902819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 183/356] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:27.903944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:27.939310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.053308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722317-a13a-4764-9b88-ff76b57a95de None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.074580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf32ff-ee3c-4cf6-bef1-cdbc30682257 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.092434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.106537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.107219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.107496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.107760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.119919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:28.120827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.121543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.121822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.122095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.124111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:28.125251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:28.126088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 10:34:28.126904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:28.127503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:28.127576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 184/357] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:28.127640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 174/358] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:27 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:28.128178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.128270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.262933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5cb1-08e0-4435-a5c9-597228536831 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.278777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f773ab2-5d83-4d3d-9482-3f86cc465f48 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.282713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.308200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.309161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.309720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.310130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.323873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d305478-d07c-40d3-8b4f-00621f178ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.324453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305478-d07c-40d3-8b4f-00621f178ec6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.324796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305478-d07c-40d3-8b4f-00621f178ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.325186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d305478-d07c-40d3-8b4f-00621f178ec6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.340046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d305478-d07c-40d3-8b4f-00621f178ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-1d305478-d07c-40d3-8b4f-00621f178ec6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:28.346020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:28.347176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:28.348040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:28.349132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 175/359] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:28.353888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9c86-0cb7-48e5-8b69-19ad549f29f6 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.353888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9c86-0cb7-48e5-8b69-19ad549f29f6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.353888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c9c86-0cb7-48e5-8b69-19ad549f29f6 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.354144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 176/360] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:28.354832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c9c86-0cb7-48e5-8b69-19ad549f29f6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.385287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.401847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:28.403724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:28.495810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c9c86-0cb7-48e5-8b69-19ad549f29f6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.525977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 185/361] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:28.527509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.542422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.543442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.543722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.543990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.544679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:28.544980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:28.546360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:28.557765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 177/362] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:28.558494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.596683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.629055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.645619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb361e8-29b2-42bc-9eed-5df7ad0502d3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.686573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.687340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.687684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.688046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.688849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:28.689165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:28.690630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330523eb-072b-4ca2-8d70-243ad82f9dc3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:28.695458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca0e4d-3adf-4a1b-b8e6-fce2fe796b67 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.696699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 186/363] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=847d13d004f94d888ecf8be41cb07086 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:28.697947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.698233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.698562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.721616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:28.723244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:28.739849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.740756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.741038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.741309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.742167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:28.742476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:28.744315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:28.755185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 178/364] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:28.756248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.825075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 187/365] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:28.826021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.879406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.908941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bda9ca-9d43-4fd1-bff2-86b8f1315e33 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:28.937962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:28.952050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:28.952694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:28.952973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:28.953246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:28.954455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:28.955891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:28.957522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 179/366] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:28.958537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:28.968811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492367b4-e61f-4424-a408-ef42486d64b6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.009044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.009694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.009972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.010244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] PATH_INFO: `/v3/users/f3fa699d653a464890ef8769d3234b99` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.011519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] RBAC: Authorizing `identity:get_user(user_id=f3fa699d653a464890ef8769d3234b99)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.013253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.016068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 188/367] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/users/f3fa699d653a464890ef8769d3234b99 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:29.016644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.133382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f674892-9000-43d0-b4e4-951cad79078e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.133640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8872cde-b780-4af9-8465-45b4bb7f4f0a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.170417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.171176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.171459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.171834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.172967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.174837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.176980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.177123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 189/368] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:29.177310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.177523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.177631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.177827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.194221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:29.207175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:29.253907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.255530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.289544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8501b87-97e7-4110-9fff-337eafef7bea None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.326560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.327301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.327584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.327854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.328588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] RBAC: Adding query filter params (role.id=93b8aa5cf7004027892f201f9b873be1, user.id=f3fa699d653a464890ef8769d3234b99, scope.system=all) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:29.328898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.330342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.343635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 190/369] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/role_assignments?user.id=f3fa699d653a464890ef8769d3234b99&scope.system=all&role.id=93b8aa5cf7004027892f201f9b873be1 => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:29.344425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.361248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 180/370] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:29.362169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.425269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:29.437073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:29.466799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e8b4a-d863-462d-ae96-395398ba1279 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.485122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e7c3-4b30-4d0f-ba13-aa36e9e6a7a1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.506015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.506974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.507464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.507885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.520635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:29.524335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.524954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.525231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.525508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.526247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=34274a6be6514c5ab10310901a4b0d84) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:29.526544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.528088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:29.529122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:29.530339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:29.531207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:29.533742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 191/371] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:29.534472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 181/372] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=4dfba98327a94751bce3982770d6465f => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:29.535030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.540078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.677401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343eac0-dae0-4fd1-9be5-2f976cc0efad None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.713465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:29.719766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.720820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.721329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.721803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.724265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.725983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.728242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 192/373] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:29.734133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.820697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25025be0-0403-4dc6-a029-93b200ceeacb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.844286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855fc64-cb3c-42d6-8f38-fd4da8eeff1e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:29.863437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:29.881673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.882808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.883296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.883762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.885090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.886778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.888879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 193/374] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:29.895374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.902017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:29.902646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:29.902952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:29.903229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:29.903911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:29.904218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:29.905592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:29.922158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 182/375] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:29.927707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:29.970099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:30.009431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87c034-9a8a-4b1e-aea2-f2e12546bd95 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:30.045924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:30.046981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.047469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.047941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.048927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=34274a6be6514c5ab10310901a4b0d84) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:30.049430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:30.051120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:30.057809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 194/376] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=847d13d004f94d888ecf8be41cb07086 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:30.156343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce66fa-5b2e-4a39-88a6-a777e4a72954 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:30.216764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710619-da94-43cc-aaf9-ece626f7e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:30.217247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710619-da94-43cc-aaf9-ece626f7e3f2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.217531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710619-da94-43cc-aaf9-ece626f7e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.217801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710619-da94-43cc-aaf9-ece626f7e3f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.289574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:30.318164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710619-da94-43cc-aaf9-ece626f7e3f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:30.319986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710619-da94-43cc-aaf9-ece626f7e3f2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:30.443234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 183/377] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:34:30.448627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:30.461508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3519b69-9f36-4b4f-9f6b-e9b0ed280359 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.461798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3519b69-9f36-4b4f-9f6b-e9b0ed280359 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.462062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3519b69-9f36-4b4f-9f6b-e9b0ed280359 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.463743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 184/378] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:30.468682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.468894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.469167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.499720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:30.504026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:30.571588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71dbe6-69e6-410e-bc93-3d6daded968c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:30.593299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 185/379] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:30.606094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:30.613757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:30.615559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.616070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.616529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] PATH_INFO: `/v3/projects/e3424e260c7f45ca91161a9eb3a1a521` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.617884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] RBAC: Authorizing `identity:get_project(project_id=e3424e260c7f45ca91161a9eb3a1a521)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:30.619587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:30.621737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 195/380] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:30 2022] GET /identity/v3/projects/e3424e260c7f45ca91161a9eb3a1a521 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:30.630729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:30.651132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:30.752254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd10412-5425-48f0-b836-a55f859fef6d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:30.793225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:30.793879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.794156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.794425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] PATH_INFO: `/v3/groups/db3473e7ff4740e3b41be3b041624bdd` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.800987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] RBAC: Authorizing `identity:get_group(group_id=db3473e7ff4740e3b41be3b041624bdd)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:30.803225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:30.804641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 186/381] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:30 2022] GET /identity/v3/groups/db3473e7ff4740e3b41be3b041624bdd => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:30.810107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:30.941796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:30.944243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79840d0-b62a-47c4-9cd1-bef0c8b2c5db None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:30.988141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:30.988879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:30.989155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:30.989420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:30.990147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] RBAC: Adding query filter params (group.id=db3473e7ff4740e3b41be3b041624bdd, role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=e3424e260c7f45ca91161a9eb3a1a521) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:30.990449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:30.992184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a68d21-b3b8-46a3-a25e-9a5fe82a51fb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:31.011161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 196/382] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:30 2022] GET /identity/v3/role_assignments?group.id=db3473e7ff4740e3b41be3b041624bdd&scope.project.id=e3424e260c7f45ca91161a9eb3a1a521&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:31.069147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:31.095341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7521-56c9-43cd-a134-c11ac2108a86 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:31.127724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cbfaa-5f2c-4435-8683-53a6048c3932 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.128050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cbfaa-5f2c-4435-8683-53a6048c3932 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.128284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830cbfaa-5f2c-4435-8683-53a6048c3932 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.129950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 197/383] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:31.135191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.135467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.135739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.141970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:31.142612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.142940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.143212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.157589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:31.163102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:31.164035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:31.164801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 187/384] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:31.172477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:31.186592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:31.187832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:31.296765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:31.311334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 198/385] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:31.337745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0b4e0-8598-48b8-bd6c-ed60ef3f475c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:31.373005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:31.373617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.373893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.374158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.374882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:31.375241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:31.376732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:31.378966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:31.387029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 188/386] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:31.392630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:31.508618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871e24-ac2f-481e-8d75-9788c2998214 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:31.548998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:31.549553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.549827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.550097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.551261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:31.552710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:31.556492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 199/387] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:31 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:31.563780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:31.678075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e899a-f0da-4bec-9e35-59a867abc1b1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:31.721105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:31.721741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.722021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.722293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.727359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:31.728819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:31.730525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 189/388] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:31 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:31.736414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:31.804878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:31.849320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b82d-c8a7-43ad-ae44-c6376c2d9ddd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:31.900279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:31.900954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:31.901229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:31.901489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:31.903423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0aca8423147fcaef5d2488c86f1a4, group_id=ca9909bd3fa5464cacf2b268a1941b66, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:31.904856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:31.929142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 200/389] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 10:34:31 2022] PUT /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:31.969629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.060790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:32.115337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f169-40ed-47b0-a5e6-cd5e9b50bd6e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:32.156383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362218d1-3b2e-4922-a7ab-7606da813419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:32.157042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362218d1-3b2e-4922-a7ab-7606da813419 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.157365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362218d1-3b2e-4922-a7ab-7606da813419 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.157687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362218d1-3b2e-4922-a7ab-7606da813419 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.170288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362218d1-3b2e-4922-a7ab-7606da813419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-362218d1-3b2e-4922-a7ab-7606da813419 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:32.175729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:32.176655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:32.177428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 190/390] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:32.182904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.204272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870f7b-5128-4e1e-8247-406c27a367ca None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.204594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870f7b-5128-4e1e-8247-406c27a367ca None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.204827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8870f7b-5128-4e1e-8247-406c27a367ca None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.206547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 191/391] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:32.213493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.213968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.214469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.238344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:32.239843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:32.303586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d59b8-42e3-48e1-8197-6dad288a7559 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:32.321712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 192/392] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:32.333541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:32.348005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:32.348730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.349011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.349280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.350003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:32.350307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:32.352647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:32.360615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 201/393] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:32.365831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.442228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:32.496978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c116b-5b8b-4ba9-a223-be1a5f52d21b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:32.545744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefc2fe-d33f-43fa-bb05-f768fc66ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:32.546474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefc2fe-d33f-43fa-bb05-f768fc66ad08 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.546805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefc2fe-d33f-43fa-bb05-f768fc66ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.547080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefc2fe-d33f-43fa-bb05-f768fc66ad08 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.548218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefc2fe-d33f-43fa-bb05-f768fc66ad08 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:32.549674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefc2fe-d33f-43fa-bb05-f768fc66ad08 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:32.551686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 193/394] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:32 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:32.557171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.558429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f8ee-0d33-426c-90d2-ee026fcf5ba1 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.558725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f8ee-0d33-426c-90d2-ee026fcf5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.559002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0f8ee-0d33-426c-90d2-ee026fcf5ba1 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.560575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 194/395] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:32.565562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.565933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.566151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.588886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:32.589312 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:32.683628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 195/396] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:32.686475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.763670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77902f0-3147-488a-a58a-f9d2b495c3ae None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:32.788802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:32.827127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:32.827765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.828040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.828305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.830547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:32.832027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:32.836241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 202/397] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:32 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:32.843027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.848945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e874d-0d5a-4e4e-a52e-be77b1e01167 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:32.892764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:32.896255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:32.896703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:32.897105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:32.911467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:32.924115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:32.925196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:32.926177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:32.930998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 196/398] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:32.934822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:32.958023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.044082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed4930-2eb6-4f8a-972a-891989935108 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.096506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.096689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307103fc-abe1-4019-b718-9047d575e69a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.097104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.097354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.097623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.100551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4e0aca8423147fcaef5d2488c86f1a4, group_id=ca9909bd3fa5464cacf2b268a1941b66, role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.102004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.119975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 203/399] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 10:34:32 2022] PUT /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/847d13d004f94d888ecf8be41cb07086 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:33.120169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.121218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.160066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.160804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.161083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.161352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.162082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:33.162479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.164587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.187746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 197/400] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:33.212912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.254105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074b3d9-9462-46b8-934a-6ffa01481d09 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.273424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.306363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.307622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.308011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.308277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.322555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:33.329604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:33.330632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:33.332172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 204/401] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:33.339820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.352950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2839c-2cae-4cc2-9d1a-0fd415e3759e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.395078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.396101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.396609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.397086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.398943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.400608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.402847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 198/402] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:33 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:33.408677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.463021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.486182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b091120-8e91-4c3c-854c-5f697f5d0595 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.525698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.526373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.526649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.526937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.527697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:33.528044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.529952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.540033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 205/403] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:33.545854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.584096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4ec6-2488-4c6b-ab47-2258ea31bea3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.624792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.657996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.658709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.658987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.659261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.661414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.662883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.664741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 199/404] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:33 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:33.671625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.716341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc85151-f595-425c-b8dd-ac1e02b58048 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.760983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4fcf1-241b-4e7b-9e36-48c5628c8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.761624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4fcf1-241b-4e7b-9e36-48c5628c8bcb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.761897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4fcf1-241b-4e7b-9e36-48c5628c8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.762159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4fcf1-241b-4e7b-9e36-48c5628c8bcb None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.763392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4fcf1-241b-4e7b-9e36-48c5628c8bcb None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.765191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4fcf1-241b-4e7b-9e36-48c5628c8bcb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.769108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 206/405] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:33 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:33.774810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693b786-047c-4956-b939-4c224a278b18 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.775086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693b786-047c-4956-b939-4c224a278b18 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.775355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693b786-047c-4956-b939-4c224a278b18 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.776604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 207/406] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:33.777274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693b786-047c-4956-b939-4c224a278b18 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:33.822886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa05d5-ff8a-48eb-a8e2-b0a6cc796144 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.836140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.859020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a98bae-b44e-402e-b172-8a7166613ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.859686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98bae-b44e-402e-b172-8a7166613ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.859951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98bae-b44e-402e-b172-8a7166613ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.860220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a98bae-b44e-402e-b172-8a7166613ef2 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.862632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98bae-b44e-402e-b172-8a7166613ef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=34274a6be6514c5ab10310901a4b0d84, group_id=ca9909bd3fa5464cacf2b268a1941b66, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.863853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a98bae-b44e-402e-b172-8a7166613ef2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.882278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 200/407] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 10:34:33 2022] PUT /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:33.883572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.883892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.884172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.901516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693b786-047c-4956-b939-4c224a278b18 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:33.905141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:33.910814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:33.912099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:33.962789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:33.963444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:33.966749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:33.966749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:33.966749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:33.968151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:33.974024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 208/408] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:33 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:33.981671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:34.046747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 201/409] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:34.126147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a48f2-bba7-4879-bf85-03cf3587475b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:34.162148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057d811-846d-4552-b77d-e8fad7a730bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:34.162774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d811-846d-4552-b77d-e8fad7a730bf None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:34.163053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d811-846d-4552-b77d-e8fad7a730bf None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:34.163320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057d811-846d-4552-b77d-e8fad7a730bf None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:34.165498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057d811-846d-4552-b77d-e8fad7a730bf None admin] RBAC: Authorizing `identity:create_grant(project_id=34274a6be6514c5ab10310901a4b0d84, group_id=ca9909bd3fa5464cacf2b268a1941b66, role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:34.166980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057d811-846d-4552-b77d-e8fad7a730bf None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:34.184214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 209/410] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 10:34:33 2022] PUT /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84/groups/ca9909bd3fa5464cacf2b268a1941b66/roles/847d13d004f94d888ecf8be41cb07086 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:34.369159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:34.479238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413f871-301f-4dfa-9ee6-02d9d8b85e82 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:34.480730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:34.535009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:34.535787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:34.536063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:34.536330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:34.547693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fc3c-267f-4753-91d8-bc55a6ec8f67 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:34.547977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fc3c-267f-4753-91d8-bc55a6ec8f67 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:34.548252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393fc3c-267f-4753-91d8-bc55a6ec8f67 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:34.549845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 210/411] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:34.555411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:34.555602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:34.555705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:34.555949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:34.560449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:34.561528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:34.562603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 202/412] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:34.569347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:34.575658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:34.577059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:34.617828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:34.699063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 211/413] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:34.742702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28501a5-aed5-4b0e-88fc-c1dcca21c12f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:34.794186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:34.795094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:34.795527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:34.795935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:34.796765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:34.797209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:34.798784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:34.807610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 203/414] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:34.814985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:34.932141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85065409-57a1-4fe0-b94a-f03baf0fd601 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:34.978402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:34.979069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:34.979403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:34.979671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] PATH_INFO: `/v3/groups/db3473e7ff4740e3b41be3b041624bdd` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:34.980778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] RBAC: Authorizing `identity:get_group(group_id=db3473e7ff4740e3b41be3b041624bdd)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:34.983622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:34.983889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 212/415] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:34 2022] GET /identity/v3/groups/db3473e7ff4740e3b41be3b041624bdd => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:34.991775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:35.028455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:35.102088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:35.143022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:35.153840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43381488-6573-4376-a09e-54186ccc8fe9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:35.214098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:35.214753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.215033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.215300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] PATH_INFO: `/v3/projects/e3424e260c7f45ca91161a9eb3a1a521` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.217091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] RBAC: Authorizing `identity:get_project(project_id=e3424e260c7f45ca91161a9eb3a1a521)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:35.218527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:35.220348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 204/416] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:34 2022] GET /identity/v3/projects/e3424e260c7f45ca91161a9eb3a1a521 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:35.230570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:35.273337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0771736-d19b-472e-a0ef-a523ab43cbbe None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:35.363058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:35.367334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c1bc7-8690-49e9-b512-5d3f2ae0032f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:35.369922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:35.370610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.370923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.371229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.400917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:35.410597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:35.411587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:35.412370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:35.413041 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 213/417] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:35.420533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:35.425815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b30fc-1821-40e5-a6b9-fbb5367ea54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:35.426537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b30fc-1821-40e5-a6b9-fbb5367ea54f None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.426842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b30fc-1821-40e5-a6b9-fbb5367ea54f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.427113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b30fc-1821-40e5-a6b9-fbb5367ea54f None admin] PATH_INFO: `/v3/projects/e3424e260c7f45ca91161a9eb3a1a521/groups/db3473e7ff4740e3b41be3b041624bdd/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.430133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b30fc-1821-40e5-a6b9-fbb5367ea54f None admin] RBAC: Authorizing `identity:create_grant(project_id=e3424e260c7f45ca91161a9eb3a1a521, group_id=db3473e7ff4740e3b41be3b041624bdd, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:35.436465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b30fc-1821-40e5-a6b9-fbb5367ea54f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:35.457238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 205/418] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 10:34:35 2022] PUT /identity/v3/projects/e3424e260c7f45ca91161a9eb3a1a521/groups/db3473e7ff4740e3b41be3b041624bdd/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:35.459129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ef9a-0a92-492c-82d1-43861ece68b6 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.459712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ef9a-0a92-492c-82d1-43861ece68b6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.460221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ef9a-0a92-492c-82d1-43861ece68b6 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.462040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 206/419] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:35.469047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.469667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.470132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.493280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:35.495016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:35.582062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 207/420] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:35.646139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:35.659124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55757aa-b6dd-4f25-a7b2-c76eb7a37970 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:35.704889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:35.705503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.705780 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.706050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.706747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] RBAC: Adding query filter params (name=member) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:35.707052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:35.708584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:35.717977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 214/421] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:35.723324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:35.813736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:35.833837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f23e5-5314-4875-846e-70ebfb3c0eb9 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:35.867811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:35.868423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:35.868704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:35.868974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:35.948794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:35.950189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:35.975753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.083047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.090810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 208/422] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:34:36.097594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.222914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9e4fb-6a36-4034-af90-5de287c7b536 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:36.253511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16f57-87a0-487e-aaa0-61634c3bf4dd None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:36.286184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:36.286864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.287276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.287551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.299107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:36.305142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:36.306003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:36.306810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 215/423] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:36.313774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.329971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.334213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc291c-ad37-41de-bcf4-b059b18cb739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:36.334898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc291c-ad37-41de-bcf4-b059b18cb739 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.335184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc291c-ad37-41de-bcf4-b059b18cb739 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.335460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc291c-ad37-41de-bcf4-b059b18cb739 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.336635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc291c-ad37-41de-bcf4-b059b18cb739 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:36.338051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc291c-ad37-41de-bcf4-b059b18cb739 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:36.340045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 209/424] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:36.341170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcac927-a147-4b71-bfad-b54ee708f16f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.341452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcac927-a147-4b71-bfad-b54ee708f16f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.341726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcac927-a147-4b71-bfad-b54ee708f16f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.349913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 210/425] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:36.349913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fb865-d24e-426c-903c-51a990286982 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.349913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fb865-d24e-426c-903c-51a990286982 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.349913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fb865-d24e-426c-903c-51a990286982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.368691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-882fb865-d24e-426c-903c-51a990286982 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:36.369988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-882fb865-d24e-426c-903c-51a990286982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:36.430377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.431034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bbcfa-5e84-49ae-8f78-2cc4e40ffaf2 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:36.454380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 211/426] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:36.455234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fb865-d24e-426c-903c-51a990286982 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.476049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:36.477174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.477624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.478293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.479714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:36.480449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:36.482735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b68470-8844-4b6a-bf33-e395e8103c50 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:36.494371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 216/427] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:36.496322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235496-16b9-4fa5-9fb9-5bcc6ef7fb6b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.496823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235496-16b9-4fa5-9fb9-5bcc6ef7fb6b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.497645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235496-16b9-4fa5-9fb9-5bcc6ef7fb6b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.503534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 217/428] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:36.503949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235496-16b9-4fa5-9fb9-5bcc6ef7fb6b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.558954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fb865-d24e-426c-903c-51a990286982 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:36.594016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb73169-b06f-4f7f-b395-9171272384e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:36.594648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb73169-b06f-4f7f-b395-9171272384e5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.594996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb73169-b06f-4f7f-b395-9171272384e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.595269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb73169-b06f-4f7f-b395-9171272384e5 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.596386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb73169-b06f-4f7f-b395-9171272384e5 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:36.597727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.597834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb73169-b06f-4f7f-b395-9171272384e5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:36.605431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 212/429] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:36.606728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.607052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.607325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.626122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:36.627317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:36.644040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235496-16b9-4fa5-9fb9-5bcc6ef7fb6b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:36.672261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.691368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:36.692650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.693462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.694186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.702723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 213/430] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:36.702723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.806325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:36.807903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:36.825062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0235ba4-0f80-4c65-8720-0345010db8eb None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:36.861324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:36.862021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:36.862307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:36.862582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:36.863350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:36.863695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:36.865140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:36.871614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 214/431] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=4dfba98327a94751bce3982770d6465f => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:36.872490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.880047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.917394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 218/432] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:36.923085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:36.924121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:36.992518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31802f70-0c4f-451e-a284-067b34b4dbab None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.029228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.029877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.030155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.030429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.042397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:37.047915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:37.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 10:34:37.049730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:37.054131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 215/433] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:37.055546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.062340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cd96d-ba6b-4266-95fc-fc21234fcb2c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.119494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.120139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.120418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.120673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] PATH_INFO: `/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.122483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] RBAC: Authorizing `identity:get_project(project_id=d4e0aca8423147fcaef5d2488c86f1a4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.123985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.125615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 219/434] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:36 2022] GET /identity/v3/projects/d4e0aca8423147fcaef5d2488c86f1a4 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:37.126368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.172434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357227e7-d17a-4bd5-a9b8-6d71fccbd63a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.174316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.180057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.226811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.227602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.227779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.228055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.228740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] RBAC: Adding query filter params (name=member) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:37.229045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.230448 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.239284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 216/435] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:37.240125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.248048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c20ab-c040-4cf5-bf4b-7925045dd154 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.294205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.295159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.295159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.295394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.309822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:37.314591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:37.315660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:37.316511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 220/436] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:37.317242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.364477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f593a9-c534-4da0-9ae2-937c4901583d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.403516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.404588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.405049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.405544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.407455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.409755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.417137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 217/437] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:37.417137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.451422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.454213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.455493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c37981-1b46-4484-905b-921a34161c80 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.496910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.497687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.497818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.498021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.532090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df24f2-059b-4c84-a7d8-27bce3cc8891 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.569579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.570425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.570728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.571003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.571657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.571756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:37.571958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.573145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.573308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.582949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 218/438] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:37.583607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.685918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.686112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.689738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 221/439] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:37.690604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.699693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dba307-39d4-437a-89da-4fe15c122a5f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.735078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.735685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.735962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.736234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.736958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:37.737264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.738776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.744381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 219/440] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=d4e0aca8423147fcaef5d2488c86f1a4&role.id=847d13d004f94d888ecf8be41cb07086 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:37.745209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.810728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fa92-3bb1-40d7-8fde-1be01e3fc0f9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.850453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34adf85-517b-42ce-994b-edb29deedb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.851029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34adf85-517b-42ce-994b-edb29deedb4e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.851318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34adf85-517b-42ce-994b-edb29deedb4e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.851590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34adf85-517b-42ce-994b-edb29deedb4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.859072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0620ef-8d66-4d7d-bf79-f9666ce271db None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:37.904636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157524c-d0f2-4def-a1c3-ddc2ecc109ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:37.905394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157524c-d0f2-4def-a1c3-ddc2ecc109ec None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.905905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157524c-d0f2-4def-a1c3-ddc2ecc109ec None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.906007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157524c-d0f2-4def-a1c3-ddc2ecc109ec None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.908620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157524c-d0f2-4def-a1c3-ddc2ecc109ec None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.908620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157524c-d0f2-4def-a1c3-ddc2ecc109ec None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.910298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 220/441] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:37.912380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0caf2d-8eb1-4a88-93ab-e2e192d03e28 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:37.912665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0caf2d-8eb1-4a88-93ab-e2e192d03e28 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:37.912940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0caf2d-8eb1-4a88-93ab-e2e192d03e28 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:37.914366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 221/442] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:37.915938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0caf2d-8eb1-4a88-93ab-e2e192d03e28 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:37.929036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:37.932635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34adf85-517b-42ce-994b-edb29deedb4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:37.934403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34adf85-517b-42ce-994b-edb29deedb4e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:37.952457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:38.050075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0caf2d-8eb1-4a88-93ab-e2e192d03e28 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.067595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 222/443] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:38.069550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.070045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.070519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.091052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:38.091674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.092282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:38.092400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.092565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.092830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.094013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.095471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:38.097205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 222/444] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:37 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:38.097799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.161138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 223/445] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:38.161916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.192880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:38.195751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:38.203994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f538a-a302-4620-aaf4-478b1df76913 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.242183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.242848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.243130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.243405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] PATH_INFO: `/v3/projects/34274a6be6514c5ab10310901a4b0d84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.244557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] RBAC: Authorizing `identity:get_project(project_id=34274a6be6514c5ab10310901a4b0d84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.245994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:38.247824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 223/446] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/projects/34274a6be6514c5ab10310901a4b0d84 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:38.253034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.271254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1813ad6-d2a6-44da-8f82-91bfbec91caa None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.308712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.309320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.309582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.309853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.310575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=4dfba98327a94751bce3982770d6465f, scope.project.id=34274a6be6514c5ab10310901a4b0d84) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:38.310903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.312341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:38.318961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 224/447] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=4dfba98327a94751bce3982770d6465f => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:38.367555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159a666-5f83-4683-afe7-cdd21c757e76 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.407217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.407852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.408125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.408392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] PATH_INFO: `/v3/groups/ca9909bd3fa5464cacf2b268a1941b66` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.409523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] RBAC: Authorizing `identity:get_group(group_id=ca9909bd3fa5464cacf2b268a1941b66)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.411208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:38.412893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 224/448] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/groups/ca9909bd3fa5464cacf2b268a1941b66 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:38.418583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.425313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.464002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:38.528011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:38.536152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fb74c-839d-4c11-965b-8d7d868f7338 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.550599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1be1ea-af96-4e80-8662-bc8b97947cef None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.575153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.576112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.576112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.576290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.577000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] RBAC: Adding query filter params (group.id=ca9909bd3fa5464cacf2b268a1941b66, role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=34274a6be6514c5ab10310901a4b0d84) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:38.577299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.579951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:38.586427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 225/449] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/role_assignments?group.id=ca9909bd3fa5464cacf2b268a1941b66&scope.project.id=34274a6be6514c5ab10310901a4b0d84&role.id=847d13d004f94d888ecf8be41cb07086 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:38.590594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.591277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.591558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.591829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.605414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:38.610972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:38.611967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:34:38.612774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:38.615063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 225/450] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:38.618569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.732760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9abd7c-5afc-40af-83e9-0cae66a6f14e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.766234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.766924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.767204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.767473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.768169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:38.768462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.769959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:38.778329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 226/451] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:38.784362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:38.876191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:38.886611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271d880-3496-4e3a-b846-db8d4d4018d7 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:38.921727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:38.922329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:38.922608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:38.922918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:38.990538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:38.992050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:39.084080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:39.095536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 226/452] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:34:39.102706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:39.128036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:39.208820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927652b-8826-412d-b80f-c7f4a8b276bc None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:39.243343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:39.243891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:39.244170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:39.244443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] PATH_INFO: `/v3/projects/e3424e260c7f45ca91161a9eb3a1a521` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:39.245691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] RBAC: Authorizing `identity:get_project(project_id=e3424e260c7f45ca91161a9eb3a1a521)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:39.247187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:39.248776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 227/453] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:34:39 2022] GET /identity/v3/projects/e3424e260c7f45ca91161a9eb3a1a521 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:39.254734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:39.360331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851670-7a63-4cfc-8262-d867b6b4e13e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:39.396020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc585-5c4c-4836-b25e-84f7fb2f7b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:39.396637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc585-5c4c-4836-b25e-84f7fb2f7b70 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:39.396913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc585-5c4c-4836-b25e-84f7fb2f7b70 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:39.397189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc585-5c4c-4836-b25e-84f7fb2f7b70 None admin] PATH_INFO: `/v3/groups/db3473e7ff4740e3b41be3b041624bdd` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:39.398421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc585-5c4c-4836-b25e-84f7fb2f7b70 None admin] RBAC: Authorizing `identity:get_group(group_id=db3473e7ff4740e3b41be3b041624bdd)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:39.399874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc585-5c4c-4836-b25e-84f7fb2f7b70 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:39.401425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 227/454] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 10:34:39 2022] GET /identity/v3/groups/db3473e7ff4740e3b41be3b041624bdd => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:39.410738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:39.517957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:39.531063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e357-84ed-42c3-9032-25b544837706 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:39.570837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:39.571435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:39.571708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:39.571975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:39.572694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] RBAC: Adding query filter params (group.id=db3473e7ff4740e3b41be3b041624bdd, role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=e3424e260c7f45ca91161a9eb3a1a521) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:39.573000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:39.574432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac5d3a-515e-4d57-abca-5659433c4fc8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:39.581181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 228/455] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 10:34:39 2022] GET /identity/v3/role_assignments?group.id=db3473e7ff4740e3b41be3b041624bdd&scope.project.id=e3424e260c7f45ca91161a9eb3a1a521&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:41.952716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8cc6-f039-4d06-935e-36e9cadfa8e2 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:41.953615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8cc6-f039-4d06-935e-36e9cadfa8e2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:41.954028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd8cc6-f039-4d06-935e-36e9cadfa8e2 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:41.955852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 228/456] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:41.961087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c119f-0f30-4f04-ad61-6c39b08d5a2f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:41.961851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c119f-0f30-4f04-ad61-6c39b08d5a2f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:41.962264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c119f-0f30-4f04-ad61-6c39b08d5a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:41.988836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-337c119f-0f30-4f04-ad61-6c39b08d5a2f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:41.990053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-337c119f-0f30-4f04-ad61-6c39b08d5a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:42.081357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 229/457] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:42.100722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6a7df-764d-451b-8c47-123ca408bf2b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.101004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6a7df-764d-451b-8c47-123ca408bf2b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.101284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6a7df-764d-451b-8c47-123ca408bf2b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.102970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 229/458] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:42.108418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87014b1a-4f3d-43b6-ac90-17f0f5199d60 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.108708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87014b1a-4f3d-43b6-ac90-17f0f5199d60 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.108979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87014b1a-4f3d-43b6-ac90-17f0f5199d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.140007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-87014b1a-4f3d-43b6-ac90-17f0f5199d60 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:42.141221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-87014b1a-4f3d-43b6-ac90-17f0f5199d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:42.227163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 230/459] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:42.316445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf475d-6747-4605-90ea-bd5e76ac182e None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.317122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf475d-6747-4605-90ea-bd5e76ac182e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.317589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf475d-6747-4605-90ea-bd5e76ac182e None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.319452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 230/460] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:42.324357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.324649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.324924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.347669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:42.348926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:42.356828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:42.445305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 231/461] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:42.550862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf475d-6747-4605-90ea-bd5e76ac182e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:42.551845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:42.631097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:42.671197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf475d-6747-4605-90ea-bd5e76ac182e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:42.671988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd58c36-7f71-443d-8e58-74d10ea4dd3b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:42.713395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:42.714317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:42.714560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.715064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.715166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.715515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.715760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.715856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.728430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:42.728947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:42.730066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:42.730801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:42.732104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:42.749941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:42.751002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:42.751848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:42.751848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:42.751848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-e1b763b8-7947-44af-b655-92d60eecfb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:42.752009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:42.752792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:42.753631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:42.753631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:42.753631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:42.756228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 231/463] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:42.756347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 232/463] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:42.757540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030dee-f65d-4767-b691-b18dca3ea566 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.757820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030dee-f65d-4767-b691-b18dca3ea566 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.758093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99030dee-f65d-4767-b691-b18dca3ea566 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.759488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 233/464] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:42.764679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:42.765598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99030dee-f65d-4767-b691-b18dca3ea566 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:42.873376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb45cc8-d28b-4ba5-bd25-d16d8535566c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:42.877190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99030dee-f65d-4767-b691-b18dca3ea566 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:42.884390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:42.911005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:42.911608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.911886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.912156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.912803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:42.913152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:42.914473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864a419-863a-4c4b-a7cd-bedf7239aef3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:42.914570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:42.915194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.915468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.915737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.916385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:42.916684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:42.918062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:42.930934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 232/465] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:42.930934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:42.930934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:42.930934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:42.935749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 234/466] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:42.936202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:42.950237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:42.951468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:43.000353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:43.038478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 233/467] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:43.039410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.048489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e3d4b-ec2b-42a7-82ea-1e0f4caee1fc None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.089807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.091101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.091517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.091946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.104826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.107026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:43.126470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:43.127627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:43.128686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:43.128686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:43.128686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:43.130435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 235/468] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:43.131356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.160839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:43.163966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca352714-7b89-4050-aac1-f43d41e3e0bf None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.200000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.200880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.201298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.201704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.202478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.204101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.230007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 234/469] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:43 2022] POST /identity/v3/users => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:43.231342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.252850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5efae-7c6d-4c5a-b16c-58b3bbe0af23 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.260958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:43.294171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102473cd-5bab-4632-b534-400415196d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.294872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102473cd-5bab-4632-b534-400415196d5c None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.295216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102473cd-5bab-4632-b534-400415196d5c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.295555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102473cd-5bab-4632-b534-400415196d5c None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.296292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102473cd-5bab-4632-b534-400415196d5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.298151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102473cd-5bab-4632-b534-400415196d5c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.327693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 236/470] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:43 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:43.334813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ae92-2145-4656-bd1d-52f0d966d0cf None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.334813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ae92-2145-4656-bd1d-52f0d966d0cf None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.334813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ae92-2145-4656-bd1d-52f0d966d0cf None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.334813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 237/471] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:43.334813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ae92-2145-4656-bd1d-52f0d966d0cf None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.371607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4250c0-9270-4205-9dff-ffe1e30b9032 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.425104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.425739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.426209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.426483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.427193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:43.427500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.428945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017cc70-582e-46cc-99a3-7b41e4737376 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.449579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 235/472] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:43.450990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.451270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.451546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.472833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:43.474125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:43.481209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ae92-2145-4656-bd1d-52f0d966d0cf None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.487078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:43.523997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.524637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.524911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.525217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.540221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.541017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:43.557734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:43.559458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:43.560370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:43.560370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:43.560370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:43.560672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 236/473] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:43.560672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.563034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 238/474] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:43.565546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.589535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:43.675736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad643d-971e-4437-a19f-16036ebc3b92 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.690160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c648758-ed0b-41fe-9d50-3862c8f2cfd9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.715829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.716686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.717126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.717529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.718301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.719903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.745684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 237/475] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:43 2022] POST /identity/v3/users => generated 248 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:43.749055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.749949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.750425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.750921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.751786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:43.752313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.753954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.773248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 239/476] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:43.779531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.790568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:43.923333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea77a81-5819-4eed-9204-592596c647d1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:43.950412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:43.958488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:43.959154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:43.959429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:43.959696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:43.960398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:43.961945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:43.989207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 238/477] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:43 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:44.073424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:44.103231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd000fc-8154-4b96-b500-bd8a90312527 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:44.140822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:44.141443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:44.141772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:44.142106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:44.142818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:44.144274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:44.156989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.sql.core [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 10:34:44.156989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 10:34:44.156989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [parameters: {'id': '59836b68aaca4fae8a8e75a9bb606750', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 10:34:44.156989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result.read() Aug 12 10:34:44.174057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return ref.to_dict() Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:34:44.175017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application yield resource Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise self.value Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application session.commit() Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 10:34:44.175922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.session.flush() Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application compat.raise_( Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 10:34:44.176807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:34:44.177653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result.read() Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:34:44.178450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [parameters: {'id': '59836b68aaca4fae8a8e75a9bb606750', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:44.180981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 10:34:44.182863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:44.184778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 240/478] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 10:34:43 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:44.190901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:44.252223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:44.296512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7057b61-1856-4fbb-87e8-282fb4e7935a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:44.333405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a254e2-2d09-4734-962b-ce0c31fb3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:44.334075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a254e2-2d09-4734-962b-ce0c31fb3d6f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:44.334348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a254e2-2d09-4734-962b-ce0c31fb3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:44.334612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a254e2-2d09-4734-962b-ce0c31fb3d6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:44.345140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a254e2-2d09-4734-962b-ce0c31fb3d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-34a254e2-2d09-4734-962b-ce0c31fb3d6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:44.350413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:44.352453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:44.354384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 239/479] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:34:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:44.359066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:44.468642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148c070-1a8d-445d-85ee-d973ffe784e4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:44.512686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:44.513649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:44.514112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:44.514583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:44.515848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:44.516343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:44.517918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef99c5c-dd48-432d-a3f0-ae4fff2f94f5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:44.531135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:44.534362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 241/480] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:45.512688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04ba7-0819-4d4d-8f5b-ef8b5d41d9d9 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:45.513212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04ba7-0819-4d4d-8f5b-ef8b5d41d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:45.513212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04ba7-0819-4d4d-8f5b-ef8b5d41d9d9 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:45.515254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 240/481] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:45.520815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e13f-9e73-4644-ae1e-1fac99ed81e4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:45.521698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e13f-9e73-4644-ae1e-1fac99ed81e4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:45.522172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5e13f-9e73-4644-ae1e-1fac99ed81e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:45.545104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f8f5e13f-9e73-4644-ae1e-1fac99ed81e4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:45.546622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f8f5e13f-9e73-4644-ae1e-1fac99ed81e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:45.631432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 242/482] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:45.667985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da92bc5-2a0d-43a7-b974-1ec535f8fe36 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:45.668286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da92bc5-2a0d-43a7-b974-1ec535f8fe36 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:45.668695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da92bc5-2a0d-43a7-b974-1ec535f8fe36 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:45.670222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 241/483] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:45.675456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:45.675958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:45.676462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:45.694867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:45.696316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:45.785644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 243/484] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:46.046400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da92bc5-2a0d-43a7-b974-1ec535f8fe36 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.071843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.166011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:46.203638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da92bc5-2a0d-43a7-b974-1ec535f8fe36 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.211716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810046b-0e9b-476d-bd9e-b31baffa9358 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.223019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:46.246728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a97215-f074-4b14-9d63-0f6ebec48015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.247665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a97215-f074-4b14-9d63-0f6ebec48015 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.248152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a97215-f074-4b14-9d63-0f6ebec48015 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.248621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a97215-f074-4b14-9d63-0f6ebec48015 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.250248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e7fa5-9348-4e1d-9b5c-21fe3b8001bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.251178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e7fa5-9348-4e1d-9b5c-21fe3b8001bc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.251691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e7fa5-9348-4e1d-9b5c-21fe3b8001bc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.252133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e7fa5-9348-4e1d-9b5c-21fe3b8001bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.261158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a97215-f074-4b14-9d63-0f6ebec48015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:46.263374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e7fa5-9348-4e1d-9b5c-21fe3b8001bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b9a97215-f074-4b14-9d63-0f6ebec48015 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:46.266616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:46.267686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:46.268556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:46.269153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 242/485] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:46.270601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dd7f-3758-41c3-a1db-eafee4c24c28 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.270924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dd7f-3758-41c3-a1db-eafee4c24c28 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.271197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8dd7f-3758-41c3-a1db-eafee4c24c28 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-883e7fa5-9348-4e1d-9b5c-21fe3b8001bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:46.272519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:46.273366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:46.274166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:46.274808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 243/486] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:46.274808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8dd7f-3758-41c3-a1db-eafee4c24c28 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.280875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 244/487] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:46.282318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.282814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.283279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.302977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:46.304598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:46.382944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 245/488] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:46.384263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8dd7f-3758-41c3-a1db-eafee4c24c28 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.384375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.424450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.424450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.424450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.424450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.424856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:46.424856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:46.424856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:46.432015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 244/489] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:46.440492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.455612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:46.510359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94081c-244d-48f1-bb13-074ebe33cf2f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.511044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:46.549419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.550770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.551284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.551816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.552674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:46.553241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:46.554956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1aebd-bae5-4bff-86f9-fc37c25aaa9e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:46.564287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 246/490] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:46.565719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95e3a-7cda-4442-a194-4c37b91a88aa None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.566198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95e3a-7cda-4442-a194-4c37b91a88aa None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.566863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce95e3a-7cda-4442-a194-4c37b91a88aa None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.568613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 247/491] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:46.573313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95e3a-7cda-4442-a194-4c37b91a88aa None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.590499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21227b7-7128-4ad2-9aeb-e9b3045d86f7 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.626206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.626856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.627130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.627394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.639387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:46.641301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-55e52f42-980d-4127-89ed-8cb26c7ec678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:46.656467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:46.657367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:46.658202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:46.658202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:46.658202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:46.662471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 245/492] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:46.663765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.664047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.664297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.683440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:46.684537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:46.704671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce95e3a-7cda-4442-a194-4c37b91a88aa None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.723372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:46.749491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.750122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.750392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.750655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.759439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 246/493] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:46.760149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.764311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:46.766374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:46.785081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:46.786072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:46.786945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:46.786945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:46.786945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:46.786945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 248/494] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:46.787587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.859189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:46.863886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1757d-3de1-41f8-a06b-0df327c6f914 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.911427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d4689-afa3-4343-9aaa-01f92de27203 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:46.912804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.913811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.915058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.915511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.916415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:46.916888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:46.918558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:46.933667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 247/495] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:46.934782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:46.954986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:46.955855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:46.956300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:46.956640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:46.970424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:46.975953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:46.976818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:46.977606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:46.979924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 249/496] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:46.980957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.007250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.031725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.051503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d77db6-f7e6-4a73-8a38-ff447e8153d5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.086158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.086832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.087114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.087386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.088027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:47.088324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.089457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f70e6-03fd-4833-8813-b1c749a3e570 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.089730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.102610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 248/497] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:47.107620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.126314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.126897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.127174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.127442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] PATH_INFO: `/v3/users/nova` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.135315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.136787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:47.151502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:47.152423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:47.153309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 250/498] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:34:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:47.154457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.212675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d37db-ae66-4441-bc8b-c56d5cd7ff35 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.235191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.245927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.246530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.246839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.247108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.247765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:47.248060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.249436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.251114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0cfc-a9b5-4aae-ac33-197c7abf7cad None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.257103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 249/499] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:47.257969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.262579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.284909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.285587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.285856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.286123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.295925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:47.301109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:47.302177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 251/500] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:47.307846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.358066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141fb52-b3de-43e1-9ca6-3f00e9dbfed0 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.392183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.392711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.392994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.393258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.399028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fdcb1-0156-4746-a5e2-24d652a19566 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.400548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.401975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-f10d443e-1ddf-41e0-98be-2465bf9a9223 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:47.414131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:47.415197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 250/501] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:47.416416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b3c6-55b8-4ba5-92f4-41f46bfd439b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.417153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b3c6-55b8-4ba5-92f4-41f46bfd439b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.417153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b3c6-55b8-4ba5-92f4-41f46bfd439b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.418235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 251/502] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:47.418764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b3c6-55b8-4ba5-92f4-41f46bfd439b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.443224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.443660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.443937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.444177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.444913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:47.445210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.446663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.485103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 252/503] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:47.485286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.486377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.492935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.530314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b3c6-55b8-4ba5-92f4-41f46bfd439b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.563669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.564293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.564572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.564839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.575068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.576525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.589795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4ef72-1b12-47df-89b6-9ac712808586 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:47.591735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:47.592951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:47.593866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:47.593866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:47.593866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:47.593866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 252/504] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:47.593866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.628257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.628866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.629167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.629436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.630097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:47.630400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.631822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c12da-d589-495a-8098-5fae2305fa4b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.639496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 253/505] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:47.640969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.641247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.641514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.658635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:47.659774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:47.691990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bf71d-ea90-47a9-b3c2-c16c4088081f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.707848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.718287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.726220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.726778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 254/506] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:47.726978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.727307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.727575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.727662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.728510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:47.728871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.730348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.771642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 253/507] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:47.771642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.844356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d689c-f9ac-4bc3-900f-eee2d141e236 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.879708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e155b00-6a4b-4818-81c6-e438823efde6 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:47.880577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.881316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.881585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.881914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.916762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:47.917381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:47.917726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:47.918064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:47.918819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:47.919192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.920642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.936490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 254/508] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:47.936490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:47.950955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:47.960449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:47.961926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:47.969898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.037272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83548d9-9d17-4d7b-b2e4-31db09deaea8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.067179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 255/509] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:48.068068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.073129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.073769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.074048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.074344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.084708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.086233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:48.101150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:48.102090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:48.102958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:48.102958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.102958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:48.102958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 255/510] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:48.103202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.161822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.169042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016211-2aaa-4518-9d89-d1bbed92d9a9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.194002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.202957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.203565 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.203839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.204106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.208858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017f11d-e7f9-4056-a6a2-2b54a90ca135 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.243045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.243670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.243946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.244217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.251516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.252995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:48.263915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:48.265188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 256/511] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:48.266062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.269971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.271617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.359014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.366763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 256/512] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:48.367570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.369211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265635cb-acc5-4211-abe9-e08ebe76beeb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.403923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.404569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.404843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.405111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.415568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.417013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.423358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:48.432769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:48.434025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:48.435775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:48.435775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.435775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:48.435775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 257/513] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:48.435775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.476855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36413ec9-4256-4916-93a5-5aef25833144 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.511195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.511816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.512088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.512351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.523070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.524549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:48.539246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:48.540153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:48.541006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:48.541006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.541006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:48.541006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 257/514] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:48.541217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.545672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788d6b8-c729-4656-984b-11703ad46fc4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.579286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.579940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.580251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.580579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.581249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:48.581635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.583341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.585944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.594579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 258/515] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:48.595476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.645141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00dd15-4efc-4f32-91b3-25ef25d95d59 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.653381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.677407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.677946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.678486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.678486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.679352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:48.679614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.681060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.696596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c443b-2b8c-4e31-a978-39d5d24ee534 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.698662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 258/516] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:48.699488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.735861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.736478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.736748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.737006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.747473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.748944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:48.762962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:48.764079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:48.765475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:48.765475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:48.765475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:48.765475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 259/517] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:48.765475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.803837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637490a6-2b6c-4a07-be6d-8af233975327 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.806135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.845520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.846155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.846449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.846719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.847358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:48.847653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.849112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.862417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 259/518] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.873660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a5d2c-8493-4313-bd20-8029e1f2b982 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:48.884521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:48.908921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:48.909516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:48.909791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:48.910059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:48.910776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:48.911081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:48.912439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:48.923799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 260/519] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:48.924413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:48.964243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d849e79-e225-4a50-8f91-fd0ba6ed1189 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.002263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.002938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.003210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.003474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.010928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.012387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:49.023570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:49.024613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 260/520] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:49.025514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.030315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9506b8-8d17-47e0-a0a1-bb2894deb146 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.051961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.065085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.065761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.066036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.066302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.105293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.126602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41145e4-a316-4e87-9b62-6952cbbb9343 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.134464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.135981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.159520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.160115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.160414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.160679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.161308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:49.161604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.162990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.174901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 261/521] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:49.175671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.242987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 261/522] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:49.243741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.262750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.279867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662bc7-4adb-4548-98c4-a884ab4bc15c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.312408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.313393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.314074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.314345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.314609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.315298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.316827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.337237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 262/523] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:34:49 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:34:49.338054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.352820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662bcba-7352-413f-b519-07f86d90cae2 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.396952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.397956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.398236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.398811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.408237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.410642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:49.424664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:49.425602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 262/524] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:49.427507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.466853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00e022-0142-4d29-a9d7-aa7e0fbd474f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.505555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.506142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.506424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.506713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.507459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:49.507771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.509228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.521346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.532733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 263/525] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:49.533647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.550811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f71a7-2bb6-4bf8-9730-30e5fdb4058c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.583168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.591443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.592083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.592364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.592634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.601767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.603702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:49.615388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:49.616241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:49.617148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 263/526] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:49.618470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.649296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c08922-bdbb-4827-b550-37f68e84fb6f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.686042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.686706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.686974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.687239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.697955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.699443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:49.713930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:49.714990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:49.715839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:49.715839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:49.715839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:49.717056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 264/527] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:49.717879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.730948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ea360-24fd-49a2-a7e6-ba36308b0155 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.766032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.766877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.767307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.767708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.768551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:49.768848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.769999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.770369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.794488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 264/528] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:49.794488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:49.828486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8ed6d-60f4-4031-82ae-4c5f785e4be3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.852691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:49.867469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.868368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.868796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.869061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.910653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f7964-d7bb-47d6-9eb1-458b8f68eaac None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:49.943546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.945002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:49.945350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.945608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:49.945878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:49.946142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:49.946861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:49.947274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:49.948866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:49.965745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 265/529] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:49.965745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.002848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:50.061755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 265/530] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:34:50.062758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.077349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b028cc-7dc8-4c40-a62d-4bc67f2cd8a4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.091608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:50.122073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.123004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.123434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.123886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.124691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:50.125133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.126646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:50.145242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 266/531] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:50.146376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.175886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b4036-4811-441b-9e54-c1ee73a87cd7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.222632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.223562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.223852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.224520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.225412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=e37ccc38bfcb43288a9f451428d293e0) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:50.225731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.227433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:50.242880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 266/532] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/role_assignments?user.id=e37ccc38bfcb43288a9f451428d293e0&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:50.242880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.263933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:50.319752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735ad2-2f9e-4343-bcbc-50440db06f81 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.373332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd54b7-2de2-4a00-b4c9-3d2490352100 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.406972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.407584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.407862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.408131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.408872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=b37e24a9e7d74e1ca95f6061beeb9343) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:50.409177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.411121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:50.414222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.415013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.415299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.415573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.420589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 267/533] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/role_assignments?user.id=b37e24a9e7d74e1ca95f6061beeb9343&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:50.420589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.428990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.430513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:50.446357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:50.447551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:50.448389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:50.448389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:50.448389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:50.448389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 267/534] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:50.455978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.571009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:50.629304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:50.674871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d091329-5da1-4c48-a794-f5b19e320d88 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.726536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f93de-0be3-4f30-9c8c-92f882a6287b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.731379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.733698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.733977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.734253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.734965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:50.735269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.736665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:50.757975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 268/535] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:50.767936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.809918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d343f-5733-4561-9375-052693d08287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.810560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d343f-5733-4561-9375-052693d08287 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.810890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d343f-5733-4561-9375-052693d08287 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.811162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d343f-5733-4561-9375-052693d08287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.821821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d343f-5733-4561-9375-052693d08287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.823257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d343f-5733-4561-9375-052693d08287 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-132d343f-5733-4561-9375-052693d08287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:50.849200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:50.850280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:50.851363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:50.854188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 268/536] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:50.859871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d343f-5733-4561-9375-052693d08287 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:50.924823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56340c-dca2-42bf-9ecf-bc0683c520d4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:50.957231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:50.973064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:50.973982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:50.974431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:50.974869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:50.988012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:50.989708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:51.002368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:51.003534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:51.004685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:51.006755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 269/537] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:51.011842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:51.062265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:51.066277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d343f-5733-4561-9375-052693d08287 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:51.135818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:51.136345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:51.136620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:51.136888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:51.137588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:51.137892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:51.139378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:51.157340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 269/538] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:51.163239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:51.214687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f640d80-fa8c-4ae3-b4d0-22ae085f3de6 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:51.266720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d15595-ca68-45a6-92db-2f831cd16781 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:51.287410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:51.288047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:51.288330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:51.288605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:51.289335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:51.289639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:51.291144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d62ba-32ee-44e2-9c87-c6354b55e237 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:51.301950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:51.302624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:51.302935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:51.303213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:51.303961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=044f1d33d9be4cdc827237fae316db0a) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:51.304274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:51.305703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:51.311622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 270/539] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:51 2022] GET /identity/v3/role_assignments?user.id=044f1d33d9be4cdc827237fae316db0a&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:51.322580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 270/540] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:51.332252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:51.371100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:51.518039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca7bb8-a872-407e-a1b9-92e1b7cffd4d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:51.532730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be977dc-ab8d-47ae-97db-c69433a58762 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:51.533014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be977dc-ab8d-47ae-97db-c69433a58762 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:51.533282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be977dc-ab8d-47ae-97db-c69433a58762 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:51.534622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 271/541] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:51.540549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:51.541361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:51.541786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:51.556689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:51.557548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:51.558020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:51.558460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:51.559380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=afcf59c6d1954210abe8421b9a5b49ae) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:51.559861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:51.561442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:51.566731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:51.568002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:51.568190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 271/542] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:51 2022] GET /identity/v3/role_assignments?user.id=afcf59c6d1954210abe8421b9a5b49ae&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:51.616895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:51.646011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 272/543] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:51.910129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:52.001905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:52.022292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9d9e9-a764-4453-bcd9-4c7636b5e68a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:52.057136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:52.057771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.058045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.058311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.069177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:52.074513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:52.075412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:52.076190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 272/544] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:52.081864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:52.183990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc26e15-b6a9-49d0-b889-9891666f2b7e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:52.232040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:52.232660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.232938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.233206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.233880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:52.234184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:52.235600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:52.250040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 273/545] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:52.255570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:52.384623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04aecaf-dcee-4b9c-b6f6-5ddd06ae0264 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:52.420190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:52.420836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.421124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.421387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.432845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:52.434386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:52.436126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-2fae287d-c4a1-4f0e-aa96-913b0d0ba1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:52.451675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:52.452645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:52.453488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:52.453488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:52.453488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:52.453488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 273/546] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:52.458940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:52.521395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:52.539637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623546-061a-44c5-943e-576c23b5410a None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.539942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623546-061a-44c5-943e-576c23b5410a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.540192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df623546-061a-44c5-943e-576c23b5410a None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.541961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 274/547] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:52.547348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.547628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.547899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.567732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:52.568987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:52.630556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b3183-7674-4f19-879b-8a0ba5d95d03 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:52.647138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 275/548] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:52.692354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:52.692893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.693170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.693437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.694085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:52.694449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:52.695909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61573-e9f8-434c-abe2-659faae3e4c1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:52.712980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 274/549] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:52.718258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:52.792878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021125b6-4772-4b6f-9cf6-4606150c048b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.793191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021125b6-4772-4b6f-9cf6-4606150c048b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.793433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021125b6-4772-4b6f-9cf6-4606150c048b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.794913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 275/550] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:52.807933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.808211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.808537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.835603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:52.836815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:52.843721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7d622-c70c-4dbe-888c-ce225f61699d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:52.868738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:52.881603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:52.882342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:52.882631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:52.882971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:52.890977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:52.892562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:52.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:52.906288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:52.907423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 276/551] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:52.911874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.009444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 276/552] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:53.020311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0266ef-6302-43b9-b8ce-1f26a95358a6 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.041248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.055908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.056528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.056808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.057081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.057822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:53.058129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:53.059625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:53.078867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 277/553] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 10:34:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:53.084720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.096071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.132828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.194887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a459f-ef7a-4abc-bcbc-c7d2bec83c2f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.231321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.231941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.232328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.232603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.253593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef6a1-2b40-4956-9a53-c63c6da4d120 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.309473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:53.311187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:53.329494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.330138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.330410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.330695 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.344502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:53.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:53.350841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:53.351673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:53.358828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 277/554] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:53.359992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.361648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.428183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 278/555] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:34:53.429431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.459339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.473393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394f814-c232-4b4b-8008-0a71391973a3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.508579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a2a7d-5774-4184-876f-9e446bda9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.509140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a2a7d-5774-4184-876f-9e446bda9b0e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.509414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a2a7d-5774-4184-876f-9e446bda9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.509679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a2a7d-5774-4184-876f-9e446bda9b0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.520105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a2a7d-5774-4184-876f-9e446bda9b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-2d9a2a7d-5774-4184-876f-9e446bda9b0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:53.524728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:53.525707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:53.526526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 278/556] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:53.527243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0893-e83e-49a3-b73f-52da92e35b95 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.527243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0893-e83e-49a3-b73f-52da92e35b95 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.527711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b0893-e83e-49a3-b73f-52da92e35b95 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.531293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 279/557] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:53.531293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0893-e83e-49a3-b73f-52da92e35b95 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.542419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66ffef-9f1c-4a68-b35b-709d9d673498 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.578080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.578973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.579249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.579518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.580336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:53.580639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:53.582439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:53.591690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 279/558] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:53.592311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.595785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.644606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b0893-e83e-49a3-b73f-52da92e35b95 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.678611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.679370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.679612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.679885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.690172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:53.692158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:53.699992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.703323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de99b15-bbc2-47bf-bf2f-5d0f8e03ca03 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-366486af-a046-4823-85c6-74651c9cf07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:53.711388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:53.712454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:53.713498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:53.713498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:53.713498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:53.715226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 280/559] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:53.716667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.716951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.717183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.735166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:53.736778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:53.746505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.747165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.747442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.747811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.748488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:53.748792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:53.750163 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:53.763084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 280/560] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:53.763084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.822717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 281/561] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:53.822717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.830734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.868148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1d7b2-731e-45d5-ba88-502e15f67953 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.913074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:53.913738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:53.914102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:53.914442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:53.928160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:53.930027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:53.945461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363530c2-821d-4b5c-bdc2-762229c4f550 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:53.947602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:53.948548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:53.949434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:53.949434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:53.949434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:53.950031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 281/562] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:53.951436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:53.980341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:53.999426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.000049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.000325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.000593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.001246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.001546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.002956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.019949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 282/563] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.019949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.070622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f062de-29ca-47e3-8b67-0f21f3a140a9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.089804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.109282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.110201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.110649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.111190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.122047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2044c-ce08-4125-a0ee-86f13cd9eb2b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.123635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.125202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:54.141070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:54.142058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:54.142990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:54.142990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:54.142990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:54.142990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 282/564] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:54.143223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.162439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.163112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.163385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.163648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.164299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.164594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.165996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.183382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 283/565] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.183382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.232593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.247506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142b327-b147-47e6-b3e3-da54a5e31528 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.280177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d6466-9f13-492b-b1fe-64a9d3b7146e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.281439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.282069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.282345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.282610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.289262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.290735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:54.302368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:54.303316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 283/566] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:54.304202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.317044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.317673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.317946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.318202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.328073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:54.332760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:54.333659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:54.334496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 284/567] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:54.335238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.337345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.402845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b6ac-0d3f-4ebe-9920-2dd3c7ff3c33 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.431708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55b684-7f3e-4628-826d-be906e8e73e3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.435221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.435823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.436099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.436366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.437001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.437300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.438692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b53a59-aa5f-4584-b763-73715732134b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.441554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.449766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 284/568] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.450949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b51ced-04c2-471f-aa55-e010e797889a None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.451228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b51ced-04c2-471f-aa55-e010e797889a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.451494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b51ced-04c2-471f-aa55-e010e797889a None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.452659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 285/569] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:54.453336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b51ced-04c2-471f-aa55-e010e797889a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.469419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.470066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.470345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.470616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.478128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.479661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:54.491612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:54.492553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 285/570] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:54.493477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.543741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.555771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b51ced-04c2-471f-aa55-e010e797889a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.591492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.592091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.592362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.592623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.593313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.593599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.595052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.599705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac956bea-10d5-47c5-9553-b6c3af14ad9b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.606640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 286/571] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.607457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.636706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.637309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.637581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.637849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.638508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.638826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.640567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af0ce0-875d-4663-a8ca-7e736311b764 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.648334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 286/572] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.649324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.649573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.649826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.666909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:54.668102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:54.692710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.713211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ecf7f-8eac-4a30-87c2-c691ce70fdf6 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.735045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 287/573] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:54.735871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.756661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.757295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.757661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.757939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.765978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.767462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:54.778406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:54.779511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:54.780471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 287/574] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:54.781072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.797449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.845850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9721bd-b3f8-4dde-8e67-0795f2d2be8c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.880854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.881463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.881785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.882116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.882882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.883190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.884626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.888018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb8dc3-e618-4a12-ae40-ae0b99535ce3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:54.904384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 288/575] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.905588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:54.927816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:54.928955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:54.930492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:54.931126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:54.931818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:54.933475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=c4434ebd2f9c42abaf5f1191681c9989) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:54.934053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:54.936101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:54.943745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 288/576] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/role_assignments?user.id=c4434ebd2f9c42abaf5f1191681c9989&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:54.944672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.019260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e447a592-30b0-4cc8-b9d6-8ba1095acfa7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.054649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.055235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.055507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.055774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.059693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.067355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.068863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:55.085180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:55.086258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:55.087681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:55.087681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:55.087681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:55.087681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 289/577] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:55.087681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.094402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ff06d-c837-4c08-9d0d-fdca48cfb108 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.138553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.139195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.139477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.140102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.140874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:55.141178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.142643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.160666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 289/578] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 10:34:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:55.161474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.170431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.203413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a26412-8a18-4c4e-af3f-1d838233e3ca None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.238263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.239014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.239289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.239553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.251312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.252807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:55.267314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:55.268281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:55.269208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:55.269208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:55.269208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:55.269958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a1bc-7b78-4dfd-a674-2fe7d3bdee2f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.273268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 290/579] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:55.274161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.300662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.306767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.307349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.307904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.308171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.319558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:55.324223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:55.325117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:55.325946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 290/580] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:55.327431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.386049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcde69d-a00f-4bdb-9e44-125bb2f74772 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.409977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.421372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.422062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.422339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.422705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.423306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:55.423834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.424965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.436199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5e25-5c53-4c58-8b3e-ab91110d3f7c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.437470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 291/581] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:55.438068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.478008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.478846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.479291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.479676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.491358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.492994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:55.507847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:55.508794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:55.509670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:55.509670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:55.509670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:55.509670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 291/582] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:55.510397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.546284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730946e3-db32-473a-ba14-5419d0374576 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.561789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.582263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.582891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.583169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.583473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.584166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:55.584506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.586080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.598128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 292/583] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:55.598758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.626846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f34c-7029-41de-95b7-c08720932ae5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.645382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.661663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.662347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.662757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.663033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.663704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:55.664006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.665394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.674303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 292/584] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:55.678922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.713414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f96d1-1b8c-4fba-b56b-8516115be889 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.746883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.747546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.747820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.748088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.760286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.761668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:55.773130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:55.774153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 293/585] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:55.775155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.786819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91276acc-5ed0-4a40-beda-43e5c8e2ead0 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.794792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.824580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.825104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.825371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.825656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.826342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:55.826636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.828102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.839840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 293/586] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:55.840586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.888698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ac82d-6700-43e2-98ce-1b39e826bad0 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.893080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:55.925738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.926458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.926977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.927114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.934327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.935788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:55.942174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d06f2-58a6-407a-a93d-9d703afe24ba None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:55.947582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:55.948479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:55.949378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:55.953473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 294/587] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:55.954071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:55.978497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:55.979164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:55.979449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:55.979719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:55.991747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:55.993853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:56.010788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:56.011833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:56.012730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:56.012730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:56.012730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:56.012730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 294/588] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:56.012951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.034161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.070559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0ecd4-0ad8-49e3-be31-262ded2e62e1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.105754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.106416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.106839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.107167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.107963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:56.108324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.109814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.120396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d47-a619-4bc3-9e22-fdf0a5839922 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.131506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 295/589] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 10:34:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:56.131506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.152392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.161672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.162308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.162638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.162939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.169614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.171299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:56.183055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:56.189000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 295/590] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:56.190104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.241081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e3e87-208f-4817-b0b5-33cccf6dbe5e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.271357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.277896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.278630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.279003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.279339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.280106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:56.280479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.281973 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.293977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 296/591] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:56.294653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.299866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e234f-31d5-4567-9646-10b23ba90414 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.333236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.333940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.334274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.334607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.335332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:56.335694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.337140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.349550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 296/592] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:56.350346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.384443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.407361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e15f-055e-4b1c-91b1-e8cab38594f3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.443174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.443900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.444252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.444585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.454213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1653b-4da3-462d-bcc5-03dc640a75fb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.456281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.458046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:56.473306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:56.474484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:56.475582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:56.475582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:56.475582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:56.480860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 297/593] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:56.480860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.496074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.496834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.497194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.497556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.498259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:56.498578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.500028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.506711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.512915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 297/594] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:56.513715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.589281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81cafd-0c99-44f0-b1ee-4cdc98cb6046 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.618728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fee49-7ba6-476e-adb2-03bf6075bc6e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.624256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.624940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.625210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.625474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/e37ccc38bfcb43288a9f451428d293e0/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.628400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.642785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=e37ccc38bfcb43288a9f451428d293e0, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.644172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.655674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.656335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.656609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.656904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.661670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 298/595] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:56 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/e37ccc38bfcb43288a9f451428d293e0/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:56.662841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.664620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.666087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:56.684045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:56.685154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:34:56.686084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:56.690232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 298/596] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:56.691274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.770540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:56.817195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65165064-4eea-4d4a-bf01-657b59b1484c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.825513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9fc9b-d682-4c3e-aa67-173f12eade81 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:56.858079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.858868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.859284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.859616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.860360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:56.860696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ba90a-bca7-44bc-b0f1-d9dd391e3423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:56.860805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.861352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ba90a-bca7-44bc-b0f1-d9dd391e3423 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.861626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ba90a-bca7-44bc-b0f1-d9dd391e3423 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.861894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ba90a-bca7-44bc-b0f1-d9dd391e3423 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/b37e24a9e7d74e1ca95f6061beeb9343/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.862526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.875554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 299/597] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:56.876570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.880537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ba90a-bca7-44bc-b0f1-d9dd391e3423 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=b37e24a9e7d74e1ca95f6061beeb9343, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:56.881990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ba90a-bca7-44bc-b0f1-d9dd391e3423 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:56.897796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 299/598] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:56 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/b37e24a9e7d74e1ca95f6061beeb9343/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:56.902829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b5dd-8a1a-435e-aa1e-8e3331dde02c None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:56.902829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b5dd-8a1a-435e-aa1e-8e3331dde02c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:56.902829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596b5dd-8a1a-435e-aa1e-8e3331dde02c None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:56.902829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 300/599] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:34:56.902829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b5dd-8a1a-435e-aa1e-8e3331dde02c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:56.939150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.004824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a47bc6-8412-4cf5-9055-904b8c78271a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.044829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.045458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.045743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.046017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.046786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:57.047212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.048848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ec6e7-7b4d-451b-8b0b-a8e4dfff438c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.049341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596b5dd-8a1a-435e-aa1e-8e3331dde02c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.060303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.071084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 300/600] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:57.072430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.072725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.072992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.089038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.089705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.089954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.090221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.094252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:57.095548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:57.097164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.099518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:57.109990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:57.111135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 301/601] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:57.112213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.182615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 301/602] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:57.183617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.215168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84169b6-1d07-4ba6-ac63-369a1c740c81 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.250105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.250760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.251041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.251305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.256901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.263122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.264647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:57.280238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:57.281433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:57.282495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:57.282495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:57.282495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:57.282495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 302/603] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:57.287157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.331049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.394578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac88295-63cf-484b-97b1-44ad674f445c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.463541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.464110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.464387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.464654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.465356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:57.465657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.467926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.480615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc744f-1612-4c69-b440-69f951b2feea None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.480787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 302/604] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:57.490880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.521900 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.522605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.522944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.523287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.523933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:57.524234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.525706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.543799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 303/605] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:57.544718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.603458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.614959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f1add-0f48-4bba-8cbe-f26738083b5b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.635091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.657981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3f1ac-66e4-482e-8dd9-daca369c28c6 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.663267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.664089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.664519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.664921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/044f1d33d9be4cdc827237fae316db0a/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.686259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=044f1d33d9be4cdc827237fae316db0a, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.688607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.697673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.698391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.698706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.698996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.710541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 303/606] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:57 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/044f1d33d9be4cdc827237fae316db0a/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:57.711727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:57.712136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:57.717267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:57.718467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:57.719452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:57.723051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 304/607] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:57.725667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.847450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677faed-781a-469a-af48-0f3559f839e1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:57.889593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:57.891048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:57.891462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:57.892120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:57.900662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:57.902307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:57.916043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:57.917144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:57.918237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:57.920447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 304/608] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:57.927073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:57.935066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:57.945817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6c642-e268-4c93-8892-a2575b58a9f2 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.019710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.020336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.020604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.020912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.022815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:58.023464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.024898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.044708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 305/609] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:58.048518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:58.052473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:58.138806 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b78e73-58a2-4eaf-aa31-906c93812c06 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.175166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.175953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.176229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.176494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.177246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:58.177546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.179060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.191643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 305/610] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:58.199612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:58.243659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bffa3f-b4cf-456e-8552-f467af90afe9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.281802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.282928 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.283280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.283646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.311511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.312983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.322415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:58.339850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:58.340863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:58.342381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:58.342381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:58.342381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:58.342381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 306/611] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:58.351573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:58.363673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547308-c2ca-4c0c-aa83-4038fa128419 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.399724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.400488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.400764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.401035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/afcf59c6d1954210abe8421b9a5b49ae/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.416507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=afcf59c6d1954210abe8421b9a5b49ae, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.417963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.433578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 306/612] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:34:58 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/afcf59c6d1954210abe8421b9a5b49ae/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:34:58.470775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:58.522185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41da1-c7b3-4d07-b7a2-c68ab63ebbac None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.562349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.563019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.563300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.563570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.564242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:58.564544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.566068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.580189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 307/613] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:58.587322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:58.710489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac6ce5-e47a-4676-aa80-284f9af5cf4c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.725467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:58.748340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.749184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.749526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.749946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.757679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.759177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-bf310b3e-1de1-45c2-8c36-79382ce1b681 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:34:58.771220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:58.772253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:58.773779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 307/614] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:34:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:58.778165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:58.880664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06122bd3-ebba-4354-93d9-bfa70229f5a8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:58.893113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bba1e-dadd-4768-89d2-6fdf90214bb2 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.893406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bba1e-dadd-4768-89d2-6fdf90214bb2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.893662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bba1e-dadd-4768-89d2-6fdf90214bb2 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.895189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 308/615] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:58.900695 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.900980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.901249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.906431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:58.922155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:58.922800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:58.923577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:58.923858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:58.924609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:58.924969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:58.926479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:58.936192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:58.937415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:58.945609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 308/616] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 10:34:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:34:58.958661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.073767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20634c7b-9b49-4afa-ba56-21fa737b521d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:59.111262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:59.111960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.112241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.112469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 309/617] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:34:59.112624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.125232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:59.126711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-2e7177ca-e33a-4172-91e8-f2131baa3c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:34:59.142267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:59.144243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:34:59.145512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:34:59.145512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:34:59.145512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:59.145512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 309/618] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:59.149637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.177064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bd03f-ec84-4e77-92a2-4618d63c6fea None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.177349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bd03f-ec84-4e77-92a2-4618d63c6fea None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.177624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bd03f-ec84-4e77-92a2-4618d63c6fea None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.179278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 310/619] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:34:59.184273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.184866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.185349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.203852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:34:59.205364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:34:59.224372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:59.288759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 311/620] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 10:34:59.336498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f40c79-9a9c-46cd-b21b-a6a74c6edbb9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:59.338719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:59.375279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:59.376266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.376950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.377438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.378378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:59.379088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:59.380663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:59.393708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 310/621] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:59.399533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.485040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.532564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3231c-3b22-4551-8838-d491a3418e06 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:59.608567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:59.609635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.611362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.611843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.629166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:59.631015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:34:59.654932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:59.655903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:34:59.656811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:59.659205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 312/622] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:59.660360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.666690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb982ba-be8a-46a8-8b91-e56bdf1674a4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:59.682166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:59.703532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:59.704261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.704607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.704877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.715953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:59.721150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:59.722067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:59.722999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:34:59.727191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 311/623] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:34:59.728046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.753335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:59.797812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad02cf-0dce-490d-8fe2-9dbbe70d8165 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:59.841860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240beac4-8a64-40a2-aee4-4613f5a8337b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:34:59.848943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:59.850864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.851378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.851868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.868897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:34:59.876215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:34:59.877239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 313/624] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:34:59.883145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.887763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:34:59.888653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:34:59.889147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:34:59.889623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:34:59.890932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:34:59.891447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:34:59.893089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:34:59.910786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 312/625] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:34:59.911946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:34:59.963281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:34:59.995635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5d56c-8a79-4da9-9bc4-ced698a9c133 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.001067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.020646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5317e5b-72bb-4cef-b423-d32ca0552afb None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.033189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.033800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.034075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.034345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.035064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:00.035730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.036826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.049566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 314/626] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:00.049566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.061050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.061633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.061909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.062173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.062869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:00.063168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.064595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16aa9cb-bf22-4796-af98-928bd5c3dbd1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.073972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 313/627] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:34:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:00.075532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15374d80-8a85-4fe9-8c8c-53efe27f23b0 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.076008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15374d80-8a85-4fe9-8c8c-53efe27f23b0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.076350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15374d80-8a85-4fe9-8c8c-53efe27f23b0 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.078391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 314/628] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:00.079117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15374d80-8a85-4fe9-8c8c-53efe27f23b0 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.151859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c21095-0e55-4631-92dd-6b6a0b9dd161 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.188053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.188292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15374d80-8a85-4fe9-8c8c-53efe27f23b0 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.188711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.188983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.189250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/c4434ebd2f9c42abaf5f1191681c9989/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.193334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.205306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=c4434ebd2f9c42abaf5f1191681c9989, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.206778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.220158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 315/629] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:00 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/c4434ebd2f9c42abaf5f1191681c9989/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:35:00.220943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.235948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.236936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.237430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.237906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.253949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.256977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.261839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-abb49217-21db-4f9d-8469-d9bd98a17014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:00.277804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:00.279096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:00.280100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:00.280100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:00.280100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:00.280100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 315/630] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:00.280766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.281011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.281282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.304992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:00.306654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:00.355573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b55bf-01e3-44f3-b3f2-b7bfc8d83e90 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.395289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.395923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.396200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.396468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.411587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.412992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.417880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 316/631] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:00.420547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:00.431210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:00.432372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:00.433466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:00.433466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:00.433466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:00.434916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 316/632] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:00.441440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.497817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.530622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7cea-9b59-4caf-96e1-1a9349664ff7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.585592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.591000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef6186-6dd3-45f1-b54b-433c5153df4a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.605810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.606587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.606989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.607461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.608219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:00.609204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.611949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.635381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 317/633] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:00.642652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.668179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.669040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.669414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.670005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.670880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:00.671346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.672830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.688540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 317/634] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:00.694216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.798840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.800579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25599b6c-888f-4c2b-9bc0-73a0b94ccedc None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.803303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21acfe-3426-4391-bbb9-c7217a51e0b6 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:00.837669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.838310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.838597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.838886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.840280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:00.841007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.841380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.841747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.846708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.848288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.849933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:00.851405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-678aceb0-2063-4191-ae45-11bf3aa7fe95 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:00.859749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:00.860952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:00.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:00.868843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 318/635] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:00.868843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b3d6-420a-48bc-badb-3dab1a96f16b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:00.868843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b3d6-420a-48bc-badb-3dab1a96f16b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:00.869189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:00.871027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 10:35:00.872356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:00.873088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b3d6-420a-48bc-badb-3dab1a96f16b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:00.873088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 319/636] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:00.873088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90b3d6-420a-48bc-badb-3dab1a96f16b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.873321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 318/637] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:00.873321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:00.929576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:00.998298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d447-3d8e-4d44-8889-7e990fd99c38 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.001396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90b3d6-420a-48bc-badb-3dab1a96f16b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.035730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.036353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.036631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.036907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.037637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:01.037942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.038490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.039327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.039469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3663f-57f8-4bdf-a4e8-c3dc56fb4fd1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.039877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.040287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.051363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:01.057766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:01.059028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:01.060139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:01.062383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 320/638] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:01.063485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.063904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 319/639] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:01.065251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.065533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.065805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.085263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:01.086879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:01.098892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.171145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 320/640] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:01.171145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.188054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dff359-8329-4cc0-b41d-3a64824306f0 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.197527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.228641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.229529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.229789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.230060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.230832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:01.231137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.232791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.256581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 321/641] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:01.256581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.289380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed9e0-37e0-43dd-8518-f330467aa992 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.328163 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.329132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.329132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.329422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.348238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.367076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f9ae6-0eba-4db9-a7ed-49a6360954d1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.416055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f450481-4398-49f7-8044-48f500107208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.416662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f450481-4398-49f7-8044-48f500107208 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.416934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f450481-4398-49f7-8044-48f500107208 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.417197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f450481-4398-49f7-8044-48f500107208 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.418066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f450481-4398-49f7-8044-48f500107208 None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:01.418611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f450481-4398-49f7-8044-48f500107208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.419766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f450481-4398-49f7-8044-48f500107208 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.421867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.423358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.436761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 322/642] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:01.437993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f450481-4398-49f7-8044-48f500107208 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.467192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.537045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 321/643] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:01.537884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.547335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f450481-4398-49f7-8044-48f500107208 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.583544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.584309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.584493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.584760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.593460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.651127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc07dba-1cf6-4e16-8b9e-554c974d79cf None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.662589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.664233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.688711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.689346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.689652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.689880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.693278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.704310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.706966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:01.724709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:01.725717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:01.726638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:01.726638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:01.726638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:01.726638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 322/644] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:01.727480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.795766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 323/645] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:01.796746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.836670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.840816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88c8d4-d364-4b99-84f0-aaf7caeb1f36 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.878708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.879462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.879752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.880027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.891710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:01.896995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:01.897898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 323/646] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:01.899489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:01.909490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96227b1-ea98-43d8-a483-409e5238a539 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:01.937477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:01.947262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:01.947904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:01.948180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:01.948453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:01.959436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:01.960921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:01.979224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:01.980209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:01.981119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:01.981119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:01.981119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:01.981119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 324/647] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:01.981119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.018673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbdc2ce-f787-4d9e-9b89-4ec7f3643dfe None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.060175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.061137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.061593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.062126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.062830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:02.063175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.064541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.078237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 324/648] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:02.083665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.089895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98776c3-71c1-46b2-a930-b6a9b6cd26c3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.106338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.136591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.137309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.137643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.137968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.149465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.151060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:02.165526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:02.166717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:02.167800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:02.167800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:02.167800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:02.168306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 325/649] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:02.168976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.197024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698b0f5-06ae-48cb-ad9e-0160d3df2055 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.200059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.233704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.234229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.234504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.234801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.235469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:02.235765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.237131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.249831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 325/650] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:02.249831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.285179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b76cc9-a311-4082-b16e-9a0e553c161b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.319741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.320497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.320863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.321225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.321943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:02.322349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.323847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.330293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.335717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 326/651] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:02.336503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.352361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a34ce-c8d5-4efe-9692-594848c2d537 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.386201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.386860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.387140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.387409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.396626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.396626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:02.407477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:02.408537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 326/652] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:02.414536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.437664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.448400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6b1d8-dbda-487c-8df6-67de75635d66 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.482334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.482968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.483247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.483515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.484212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:02.484457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.485827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337913-ca22-4dcd-b674-eeeb3e36fae8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.497110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 327/653] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:02.498249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b7ec7-4605-4bec-9feb-0a7fd05a818d None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.498524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b7ec7-4605-4bec-9feb-0a7fd05a818d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.498811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b7ec7-4605-4bec-9feb-0a7fd05a818d None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.500258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 328/654] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:02.500951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b7ec7-4605-4bec-9feb-0a7fd05a818d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.507989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eafb9ad-386f-4d55-8456-2fbfac5e8af8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.541172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.541800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.542074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.542337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.550974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.553139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.554634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:02.568801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:02.569919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:02.570969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:02.570969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:02.570969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:02.570969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 327/655] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:02.571285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.608402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b7ec7-4605-4bec-9feb-0a7fd05a818d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.640464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.641082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.641351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.641616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.648163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.649627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:02.660907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:02.661968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 329/656] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:02.663158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.671671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e00579-ff35-40fb-87b0-26f15b62927d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.675298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.704294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.704894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.705164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.705426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.706157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:02.706454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.707996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b1163-956b-41bf-9055-518a52aa79c1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.725360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 328/657] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:02.726714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.726927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.727195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.764084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a793dec-b378-4a5a-a0fe-3e81906e5d8a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.804261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.804951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.805223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.805495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.813376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.814891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:02.827439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:02.828518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:02.829561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:02.832193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 330/658] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:02.832193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.863009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:02.864283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:02.904947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.911991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:02.932405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 329/659] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:02.933211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:02.936873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c70870-adcc-4816-b204-12b77ebec06c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:02.973067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:02.973670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:02.973944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:02.974211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:02.974877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:02.975176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:02.976550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:02.989389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 331/660] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:02.990118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.049809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe564355-71c1-4bf8-8f5f-ef422a9e17fb None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.085877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c40fc-500c-4d05-bb63-c29965758ad3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.086045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.086650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.086995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.087384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.088186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:03.088494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.089920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.108222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 330/661] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:03.108222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.116750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.123862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.124607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.124984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.125351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.150198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.198202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.199769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.206213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ea4f-f745-4af2-8f1c-a742d14fbcd3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.239421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.240007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.240281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.240552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.241240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:03.241542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.242982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.254083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 331/662] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:03.254894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.303921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 332/663] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:03.304803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.333979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.356434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.359338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d20d5b-536f-44b0-be74-51e3414cb615 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.393242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.393858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.394126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.394433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.401819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.402759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95483d4-1774-4dfd-9f96-53bf3996a5d5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.403245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:03.413971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:03.415096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 332/664] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:03.416074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.439899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.440506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.440781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.441053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.442206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=e37ccc38bfcb43288a9f451428d293e0) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:03.442752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.445347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.454383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 333/665] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/role_assignments?user.id=e37ccc38bfcb43288a9f451428d293e0&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:03.467020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.524142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab4137-a074-4e15-a0d8-4987cadbc30b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.561854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.562443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.562719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.562981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.574713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:03.576067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:03.580065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:03.581224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:03.582288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:03.586524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 333/666] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:03.587372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.588086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fecbd-01aa-4fe1-9bf7-f316f0ea2f01 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.612432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.631049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.632003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.632274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.632536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.633257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=b37e24a9e7d74e1ca95f6061beeb9343) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:03.633562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.635749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.642727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 334/667] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/role_assignments?user.id=b37e24a9e7d74e1ca95f6061beeb9343&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:03.643521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.716349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce369-8808-4e11-862d-50c56405fb23 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.754632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.755871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.757033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.757033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.765380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fc0e1-f569-4305-b547-1342e4eae2f7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.778417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.780055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:03.801311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:03.802326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:03.803304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:03.803304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:03.803304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:03.803304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 334/668] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:03.804055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.807950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.808577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.808854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.809124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.809865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:03.810166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.812400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.833791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 335/669] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:03.834443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:03.856714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.893756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:03.929170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4b00-6394-4fa0-8025-13f22152a611 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.959790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e57ae-7730-4442-8dc2-4453cd8afb77 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:03.970088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:03.970712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:03.970992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:03.971257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:03.971929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:03.972292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:03.974342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:03.988104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 335/670] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:03.988962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.013517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.014127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.014400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.014662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.015831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:04.016132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.017501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.029617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 336/671] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:04.030465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.118452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdca2db-5227-4b14-9b5a-7f5f85ea51fa None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.151045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.152959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.153568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.153899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.154167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.157076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.159437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6880c5-6422-4ec0-91d6-385133f70c13 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.196587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.197208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.197777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.198033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.209373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.210966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:04.226813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:04.227801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:04.228756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:04.228756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:04.228756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:04.232795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 337/672] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:04.233637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.243601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.246122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.342759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37f7ba-8cd0-4769-98a5-cd6fd6f2a686 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.368952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.376278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 336/673] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:04.377378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.382827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.383471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.383747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.384011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.393084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.394851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:04.406866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:04.407767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:04.408642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:04.411116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 338/674] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:04.412168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.415887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.492289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10216c-3ce9-414a-95cc-2da55b64024f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.527987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.528590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.528865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.529151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.529774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:04.530071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.531477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.548145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 337/675] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:04.548145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.553620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89087604-d78a-42ea-8f7a-6efe54fabd53 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.599403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.600423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.600842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.601777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.616346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.618236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:04.637197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:04.638373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:04.639581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:04.639581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:04.639581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:04.641997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 339/676] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:04.643032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.658477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.667006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9fc53-d54d-4e18-9d54-9d074b349202 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.702624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.703133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.703584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.703998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.704328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.705123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:04.705564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.707271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.725595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 338/677] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:04.726575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.770316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34a71-89b3-47e7-9b0b-ab0ce6ffe6a6 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.805509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.806331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.806741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.807156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.815111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.816724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:04.828375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:04.829516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:04.830523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:04.834904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 340/678] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:04.835903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.856790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffaf9a-0687-4131-8aef-665cd2bad9da None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.902139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.903543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.903989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:04.904408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:04.905473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:04.905911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:04.908106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:04.923180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 339/679] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:04.924205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:04.943207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.946337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:04.950456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3492b8-d52f-4c35-bf78-d85380451081 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:04.998341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:04.999315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:04.999818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.000421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.001521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=044f1d33d9be4cdc827237fae316db0a) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:05.002043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.003948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.016061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 341/680] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/role_assignments?user.id=044f1d33d9be4cdc827237fae316db0a&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:05.017298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:05.048103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ae741-ddd7-4aac-8c6f-037cba856cb4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.092667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.093304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.093581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.093850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.094599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:05.094925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.096364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.118556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 340/681] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 10:35:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:05.124726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:05.239809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:05.246934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246d4a-bf07-49cc-b3b3-76d388209783 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.281617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2a2ae-9968-4285-a117-8a5e8ed1d85d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.284404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.285110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.285389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.285645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.295284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.296847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:05.309205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:05.310122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:05.311062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:05.311725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 342/682] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:05.318279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:05.328756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4deaee2-e89a-4ae6-bf8b-ac676f6d69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.329379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaee2-e89a-4ae6-bf8b-ac676f6d69c7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.329656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaee2-e89a-4ae6-bf8b-ac676f6d69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.329924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4deaee2-e89a-4ae6-bf8b-ac676f6d69c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.346963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:05.422349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deaee2-e89a-4ae6-bf8b-ac676f6d69c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.424439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4deaee2-e89a-4ae6-bf8b-ac676f6d69c7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.441889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bcb14-2653-47e1-8db1-f1ed9c16e78c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.486162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.491150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.491370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.491646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.492365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:05.492674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.494130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.523014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 343/683] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:05.526937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:05.530166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:05.573711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 341/684] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:05.575125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0df90-be19-4add-8cb1-e2b3837e073f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.575407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0df90-be19-4add-8cb1-e2b3837e073f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.575672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0df90-be19-4add-8cb1-e2b3837e073f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.581168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 342/685] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:05.581988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0df90-be19-4add-8cb1-e2b3837e073f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:05.628743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:05.648044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e9fce-f50a-4bd1-9183-8257998cf805 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.682810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.683571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.683941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.684336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.685166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=afcf59c6d1954210abe8421b9a5b49ae) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:05.685570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.687136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e492-88ea-4c2a-9609-e0dc774a315e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.693589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 344/686] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:05 2022] GET /identity/v3/role_assignments?user.id=afcf59c6d1954210abe8421b9a5b49ae&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:05.694976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d09ced-2c75-48d2-a1d8-fd965516e258 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.695348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d09ced-2c75-48d2-a1d8-fd965516e258 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.695710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d09ced-2c75-48d2-a1d8-fd965516e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.721842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-74d09ced-2c75-48d2-a1d8-fd965516e258 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:05.723747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0df90-be19-4add-8cb1-e2b3837e073f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.725323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-74d09ced-2c75-48d2-a1d8-fd965516e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:05.786309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.787346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.788101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.788392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.803206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.804729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-48b99233-2c7a-4d0a-ad04-83465401ff64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:05.822718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:05.823752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:05.824622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:05.824622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:05.824622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:05.824622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 343/687] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:05.825166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb76366-a9f1-4221-b873-bc543133a575 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.825449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb76366-a9f1-4221-b873-bc543133a575 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.825713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb76366-a9f1-4221-b873-bc543133a575 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.831345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 344/688] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:05.832309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb76366-a9f1-4221-b873-bc543133a575 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:05.838396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 345/689] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:05.839986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.840337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.840677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.860958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:05.861933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:05.863224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:05.947440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 346/690] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:05.956160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb76366-a9f1-4221-b873-bc543133a575 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:05.991961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:05.992572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:05.992851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:05.993121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:05.993769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:05.994069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:05.995462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.007253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 345/691] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:06.012764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.023832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.115291 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea03978-dd1b-4a8f-98ba-f8e05c38d240 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.159611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.160346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.160621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.160888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.170820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:06.172335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:06.186045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:06.186977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:06.188454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 347/692] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:06.193194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.233531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.308192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.320941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.333591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f2759-0471-40ac-899a-3f7129e35a45 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.358148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a008ca4b-b2bf-45c2-b96d-18211f709c32 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.380843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.381691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.381966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.382310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.383305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:06.384024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:06.385912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.400126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.400762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.401034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.401301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.401590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 346/693] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:06.402634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.414709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:06.421100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:06.422219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:06.423199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:06.426798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 348/694] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:06.428749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.523194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5ac54-a293-4ea9-b8f5-7a2f1fda8e5d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.544217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72252-472a-421b-a34f-9f37dd572ccb None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.561081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.561730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.562021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.562712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.574010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:06.575582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.576558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.579334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.585213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.586296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.587597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.588231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.589215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=c4434ebd2f9c42abaf5f1191681c9989) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:06.589743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:06.591385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:06.595771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:06.596696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:06.597806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:06.597806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:06.597806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:06.601137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 349/695] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/role_assignments?user.id=c4434ebd2f9c42abaf5f1191681c9989&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:06.601923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 347/696] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:06.602500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.602788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.708732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e46c2e-74c8-4c60-b777-5252857c34b9 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.721622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c0d2e-205c-4a8d-b443-76eb81785211 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.760814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.761430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.761704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.761971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.762623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:06.762945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:06.767809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.774890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.775501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.775773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.776037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:06.780632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:06.780981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:06.782396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:06.797789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 348/697] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:06.804439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.807350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 350/698] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:06.813093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:06.887011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.896571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:06.948278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6102b5-9950-402f-8e5c-98c6b6013267 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.955639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe33f-6a7c-4377-ad2c-3ff7e4595383 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:06.994940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:06.995977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:06.996252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:06.996659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.004472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:07.005503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.005788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.006061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.006708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:07.008807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:07.009281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:07.010748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:07.030249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:07.031362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:07.032468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:07.032468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:07.032468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:07.032468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 351/699] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:07.038500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:07.042267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 349/700] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:35:06 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:07.156770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a33c-94f0-4a4f-a465-29ce3e30f3d4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:07.164679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:07.195725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:07.196345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.196620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.196887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.197601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:07.197906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:07.199456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:07.212992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 352/701] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:07.218495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:07.326141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307a80a-06a4-496b-90df-8162dd149c1d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:07.342566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:07.368753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:07.369390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.369664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.369930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.377552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:07.379085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-8f736c3b-d95e-4d68-a99d-ef1a56dba678 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:07.391109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:07.392069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:07.393000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 350/702] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:07.397795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:07.439065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbed35-c296-474a-be4d-82a6aa6f5378 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.439392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbed35-c296-474a-be4d-82a6aa6f5378 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.439605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbed35-c296-474a-be4d-82a6aa6f5378 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.441068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 351/703] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:07.446390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.446761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.447035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.466703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:07.467630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:07.519148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33b53-f1ac-4325-b7a2-f3b37786d934 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:07.554720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 352/704] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:07.562315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:07.563196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.563613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.564021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.564901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:07.565361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:07.567025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:07.585985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 353/705] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:07.591278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:07.734378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36bca5-379b-4479-afc4-537157c888d8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:07.736407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:07.784305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:07.784965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:07.785245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:07.785515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:07.880151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:07.881351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:07.883149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:07.948038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:08.010095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 353/706] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:08.015890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.018969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:08.109640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b423bb6-e036-4cbe-abf5-ea037e0cce87 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.172174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.173684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.174310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.176369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4145f1-8f51-42ed-ab6e-161e65e3ad17 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.176867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.177651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.180556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-4c5366f1-c3aa-46eb-9987-e45d169f6af0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:08.196838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:08.197897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:08.198777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:08.204737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 354/707] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Aug 12 10:35:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:08.206993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32147-bb6c-4930-84dc-2c18a8f75dd9 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.209044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32147-bb6c-4930-84dc-2c18a8f75dd9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.210545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32147-bb6c-4930-84dc-2c18a8f75dd9 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.213084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 355/708] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:08.213988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e32147-bb6c-4930-84dc-2c18a8f75dd9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.232413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.233152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.233494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.233825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.247439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.249164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e3fb3291-75ea-4f50-8f28-0c3c6a0c3d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:08.263907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:08.265299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:08.266185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:08.266185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:08.266185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:08.266185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 354/709] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:08.267656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.268003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.268339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.290246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:08.291857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:08.317319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:08.331721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e32147-bb6c-4930-84dc-2c18a8f75dd9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.363070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:08.373716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.374406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.374800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.375158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.375882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:08.376273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.377954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.384423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 356/710] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:08.385349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.386620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 355/711] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:08.391843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.563089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9389-aa62-40bc-8a48-21148675095e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.587980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec488b-15da-491f-bab9-2dd7a84f4dad None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.612033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.613036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.613533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.614021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.614887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:08.615381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.617897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.643905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 357/712] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:08.651669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.653815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.654499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.654896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.655234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.655975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:08.656339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.657787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.666721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 356/713] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:08.687547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:08.739022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.793989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:08.812549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af619e96-660b-496a-9918-12d0d83d3f5c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.858705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.859547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.859827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.860365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.876874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.878335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.880057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50465b77-ce5f-409d-b8df-61924757776b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:08.900758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:08.902172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:08.903121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:08.906636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 358/714] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:08.907881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.916247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:08.916977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:08.917253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:08.917527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] PATH_INFO: `/v3/services/network` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:08.918157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:08.921198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:08.933557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:08.935914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:08.937855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 357/715] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:08.942771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:08.994567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:09.034309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431fca2-6b46-432e-8174-42a697f6bec4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:09.070762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887901e3-ccf7-4e02-af4b-ae55cc4d26da None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:09.076368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:09.076981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.077255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.077518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.078211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:09.078504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:09.080030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:09.088746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:09.100521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 359/716] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:09.106456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:09.142649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:09.143630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.144110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.144677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.146652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] RBAC: Adding query filter params (name=network) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:09.147210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:09.151034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:09.168962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 358/717] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:09.181173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:09.275602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af253117-26d5-4c42-b46d-72b2ec018dfc None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:09.334863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:09.340322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:09.341001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.341438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.341771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.342568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=e37ccc38bfcb43288a9f451428d293e0) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:09.343006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:09.344609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049dce-7c1b-4f94-a805-cf1e92d0d931 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:09.351039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 360/718] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:09 2022] GET /identity/v3/role_assignments?user.id=e37ccc38bfcb43288a9f451428d293e0&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:09.352331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dd8e5-f592-464a-adb7-93521fb2937c None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.352673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dd8e5-f592-464a-adb7-93521fb2937c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.353008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dd8e5-f592-464a-adb7-93521fb2937c None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.353898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb49c82-fcfe-4f70-a5f5-c6d01f51302c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:09.358870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 361/719] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:09.360375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f29cf-b35f-4e6f-9d8e-1856455deadd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.360721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f29cf-b35f-4e6f-9d8e-1856455deadd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.361054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f29cf-b35f-4e6f-9d8e-1856455deadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.380508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-274f29cf-b35f-4e6f-9d8e-1856455deadd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:09.381848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-274f29cf-b35f-4e6f-9d8e-1856455deadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:09.402283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:09.402851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.403115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.403386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.404027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] RBAC: Adding query filter params (type=network) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:09.404326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:09.405815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55a3e-8b23-40d6-8c60-fb306f89609d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:09.415908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 359/720] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:09 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:09.458701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 362/721] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:09.544872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6d775-338c-4bdb-b84e-f95d4bb7341d None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.545147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6d775-338c-4bdb-b84e-f95d4bb7341d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.545417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6d775-338c-4bdb-b84e-f95d4bb7341d None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.547137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 360/722] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:09.552828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.553109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.553377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.573242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:09.574449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:09.647636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 363/723] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:09.745636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6d775-338c-4bdb-b84e-f95d4bb7341d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:09.792310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:09.867108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6d775-338c-4bdb-b84e-f95d4bb7341d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:09.908499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:09.909325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:09.909695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:09.910114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:09.925364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:09.929712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:09.930827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:09.931954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:09.932989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 361/724] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:09.938273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.039043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:10.099326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:10.103210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276df610-2408-432d-8ab0-0cfb2e0e0600 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.139732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.141193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.141663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.142242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.143142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:10.143648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.145313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.154624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 362/725] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:10.157916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126e936-4abc-4476-b5cc-8942fee2f219 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.159874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.259401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.260256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.260540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.260856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.269031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e40b3-3720-4ea1-b600-83f041853115 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.301113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:10.303790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.304680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.305146 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.305597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:10.305717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:10.306575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:10.307448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:10.313562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 364/726] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:10.314598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.325258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.327060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:10.343167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:10.344115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:10.344999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:10.344999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:10.344999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:10.347226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 363/727] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:10.356536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.383113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:10.483090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35829-6b8e-47aa-accb-1445ed67884c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.536335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d81d1d-6d66-4f2f-b726-6e262ccdf8c5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.547682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.548299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.548579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.548850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.549504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:10.549803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.551307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.568506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:10.569179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 364/728] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:10.570217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.594631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.595270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.595583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.595907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.596756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:10.597058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.598612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.607941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 365/729] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:10.620201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.672613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:10.698109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547c398-85ee-43e7-893e-528416283c79 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.733127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.734135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.734601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.735088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.743565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.745412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:10.757924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:10.758959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:10.759897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:10.762439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 365/730] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:10.777807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7fda2-eaf9-4cbe-bd3f-0af69fc319a8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.791710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.817408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.818122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.818406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.818697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.840546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.842013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:10.857737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:10.858716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:10.859612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:10.859612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:10.859612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:10.859612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 366/731] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:10.868788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:10.913193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:10.930631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370ee9-394e-46f0-b662-3a83eafd07c8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:10.976850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:10.977493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:10.977749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:10.978022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:10.978806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:10.979390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:10.992217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:10.997522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.004774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f86b8-cf1e-4910-aab1-4c08dfe2bc7e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.028837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 366/732] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:11.034864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.091380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.092233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.092518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.092788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.093448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:11.093751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.095925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0b27c-9dfc-4b3e-9a0b-b8c35d8f1659 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:11.113022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 367/733] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:11.114665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3e213-7787-4c5c-b5f5-5bfe75dcbbe1 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.114966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3e213-7787-4c5c-b5f5-5bfe75dcbbe1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.115235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3e213-7787-4c5c-b5f5-5bfe75dcbbe1 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.121923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 368/734] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:11.122913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3e213-7787-4c5c-b5f5-5bfe75dcbbe1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.161965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df37d64-7a0b-4b51-ab54-2cf3e1a7c24b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.206410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d0071-635e-424c-a726-66b5123e92a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.207158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d0071-635e-424c-a726-66b5123e92a6 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.207487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d0071-635e-424c-a726-66b5123e92a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.207768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d0071-635e-424c-a726-66b5123e92a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.276893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.289792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d0071-635e-424c-a726-66b5123e92a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.291395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d0071-635e-424c-a726-66b5123e92a6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:11.357625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.370708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3e213-7787-4c5c-b5f5-5bfe75dcbbe1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.399525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 367/735] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 10:35:11.399525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.399525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.399525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.413856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.414926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.415403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.415871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.417125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:11.418317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:11.424615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.426507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:11.439676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:11.440649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:11.441671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:11.444328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 369/736] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:35:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:11.445411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.494844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 368/737] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:11.495890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.532744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.557080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24efae80-1e5f-4631-86cb-b2b1eb0eb372 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.595572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.596796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.597356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.597903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.609110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.610947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-3d1f8dac-5440-4904-80f4-f8bb500a1b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:11.626975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:11.627932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:11.628903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:11.628903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:11.628903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:11.630996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 370/738] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:11.635193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9b283-5380-4a09-85ae-6f1c6784f6d6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.636051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97a47-4e79-4d52-97f5-355b1dda5101 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.636532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97a47-4e79-4d52-97f5-355b1dda5101 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.637113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b97a47-4e79-4d52-97f5-355b1dda5101 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.638914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 371/739] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:11.642760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b97a47-4e79-4d52-97f5-355b1dda5101 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.645920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.674550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.675188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.675578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.675849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.676582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:11.676883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.678321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52d51-d447-47d5-8b1a-a8735e1b4d7a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:11.696059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 369/740] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 10:35:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:11.697354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.697644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.697913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.715277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:11.716453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:11.769230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b97a47-4e79-4d52-97f5-355b1dda5101 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.802952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 370/741] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:11.803860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.811702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.812371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.812644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.812909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.813616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:11.813913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.815361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:11.826398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.829727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 372/742] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:11.830812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:11.896783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:11.925508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f1af1-6531-4104-8b1e-af5619362982 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.939392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad70c-e33f-425c-b5c4-0d488f7b5445 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:11.967553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676be54-1ea2-413a-b85d-f201741a1609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.968172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676be54-1ea2-413a-b85d-f201741a1609 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.968629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676be54-1ea2-413a-b85d-f201741a1609 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.968916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676be54-1ea2-413a-b85d-f201741a1609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.974947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:11.975557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:11.975829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:11.976097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:11.976730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:11.978538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.000347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 373/743] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:11 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:12.001053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.064128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676be54-1ea2-413a-b85d-f201741a1609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.065554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b676be54-1ea2-413a-b85d-f201741a1609 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.079211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.136244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d572d99-2ec6-408b-a8f5-d447c27bfa91 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.156657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.178120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.179111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.179583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.180052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.181776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 371/744] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 10:35:12.183073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575206-b78f-42e9-b183-fb435808f3ec None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.183615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575206-b78f-42e9-b183-fb435808f3ec None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.183615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575206-b78f-42e9-b183-fb435808f3ec None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.184880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 372/745] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:12.185623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7575206-b78f-42e9-b183-fb435808f3ec None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.189085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.190721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:12.202190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:12.203178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:12.204067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 374/746] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:12.204546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.295179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7575206-b78f-42e9-b183-fb435808f3ec None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.307313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.321317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0294d8-b701-4ea1-8d02-c513fef40014 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.333478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706d8d3-b9dc-45af-ba99-93836433badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.334114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706d8d3-b9dc-45af-ba99-93836433badd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.334489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706d8d3-b9dc-45af-ba99-93836433badd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.334703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706d8d3-b9dc-45af-ba99-93836433badd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.345556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706d8d3-b9dc-45af-ba99-93836433badd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-3706d8d3-b9dc-45af-ba99-93836433badd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:12.350294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:12.351261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:12.352113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 373/747] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:12.352815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.353514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.353514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.364362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.365003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.365280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.365549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.370951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:12.372139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:12.377784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.379565 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:12.396090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:12.397077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:12.397975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:12.397975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:12.397975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:12.397975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 375/748] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:12.398216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.430203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.458714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 374/749] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 10:35:12.458714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.518246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f59a6-b20b-48eb-b139-0c7ec87c4f14 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.554844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.555602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.556042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.556379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.557200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:12.557566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.559245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.577286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 376/750] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:12.577881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.579079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.580598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772e19c-006c-4998-8721-7ab6b4c80660 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.625908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.627156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.627514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.627858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.628942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:12.629317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.631489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.643291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 375/751] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:12.644551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.682253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.693481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0c633c-85d2-4322-9a4e-bbf0d1c9f545 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.729591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.730466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.730922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.731363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.732255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:12.732771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.734386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.746516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 377/752] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:12.748109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.769325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bef6-4d21-433c-9563-cbea75ceb834 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.809435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.810200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.810809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.811098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.811978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=c4434ebd2f9c42abaf5f1191681c9989) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:12.812291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.813724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.819507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 376/753] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/role_assignments?user.id=c4434ebd2f9c42abaf5f1191681c9989&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:12.820179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.852454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:12.874799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827a37-4d93-4210-b6e1-266971ec20ff None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.912787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:12.913003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:12.913259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:12.913500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:12.925435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:12.927067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:12.948371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:12.949345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:12.950258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:12.950258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:12.950258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:12.950430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323c0b2-f0e7-4154-b52e-2b8b0d7f9f69 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:12.953534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 378/754] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:12.954648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:12.958749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:13.006744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.007776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.008245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.008702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.010118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.012160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.035428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 377/755] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:12 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:13.036589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.137570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba0095-68cc-4aec-ad7c-81be75e474c5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.222287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.224410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.224681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.224944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.227102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:13.236966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.239020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.252207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd448503-7a02-499e-8a56-1f79cd51c809 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:13.253417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:13.254323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:13.255300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 379/756] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:13.263493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.306562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.307201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.307477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.307972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.309500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:13.309813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.311219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.328419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 378/757] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:13.335452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.340038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:13.394932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f9b3-8d07-4e0b-a6c5-6fa609fa4de5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.459293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.459903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.460174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.460438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.461138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:13.461436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.462895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.487383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 380/758] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:13.493469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.498559 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5f702-ad47-4a45-b7fe-4e0e40d09c97 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.567093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.567724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.568055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.568327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.584022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.585466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:13.605929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:13.608216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:13.610444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 379/759] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:13.615062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.627059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:13.715858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddf2d9-f1ef-4bba-af5c-341cfaf73f8c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.728772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9ce3c-5278-40c2-b4b2-da17de135c24 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.751654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.752178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.752451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.752717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.753450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:13.753787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.755265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.758812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:13.776143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 380/760] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:13.781632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.799369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.800462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.801012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.801496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.802421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:13.802958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.804587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b1a6-6b0e-40e7-8113-ba9d22868ad3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.824945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 381/761] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/role_assignments?user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:13.852185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:13.894027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a2a9-0b68-4373-b52e-51568834b79b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:13.936070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:13.936710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.936986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.937253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.948883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:13.950350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:13.966614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:13.967657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:13.970405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:13.970405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:13.970405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:13.970405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 381/762] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:13.971692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327eee8-ca41-412c-a703-10bc45daa35e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.971976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327eee8-ca41-412c-a703-10bc45daa35e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.972288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327eee8-ca41-412c-a703-10bc45daa35e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:13.974103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 382/763] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:13.977327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:13.979140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:13.979431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:13.979705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.017904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:14.019962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:14.121185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab4b0-e803-496c-9ec3-74b0eda1a1a3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:14.137478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 383/764] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:14.148272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:14.174856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:14.175842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:14.176320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:14.176788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.177634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:14.178147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:14.179819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:14.198345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 382/765] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:14.203498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:14.330513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805de17-8a4c-4377-acf1-75430b0c8127 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:14.352815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:14.383646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:14.384278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:14.384547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:14.384812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.395691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:14.397136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:14.413241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:14.414157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:14.415705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 384/766] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:14.423795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:14.438721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:14.551736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95928d-9bae-4bc6-8fc6-df87299d0a55 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:14.585164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:14.585732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:14.585987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:14.586252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.586904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:14.588426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:14.597642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:14.598718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:14.599563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 385/767] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Aug 12 10:35:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:14.606511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:14.630543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2481112-0433-4533-80d2-c309406d3255 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:14.666027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:14.666979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:14.668043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:14.668458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:14.668869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.669777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:14.670248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:14.672802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:14.685622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 383/768] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:14.692076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:14.747112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:14.803704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bac5d23-f2a5-4994-bf1b-3fa70177d5fc None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:14.814369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a56be6c-6297-434f-96c1-461e5c7cf48c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:14.859308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:14.859864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:14.860163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:14.860423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.861175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:14.861647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:14.863244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:14.873554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 386/769] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 10:35:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:14.879286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:14.889711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240abfc-b83e-4812-9d0b-4076ea47633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:14.890702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240abfc-b83e-4812-9d0b-4076ea47633b None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:14.890988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240abfc-b83e-4812-9d0b-4076ea47633b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:14.891252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240abfc-b83e-4812-9d0b-4076ea47633b None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/e37ccc38bfcb43288a9f451428d293e0/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:14.895434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240abfc-b83e-4812-9d0b-4076ea47633b None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=e37ccc38bfcb43288a9f451428d293e0, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:14.896863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240abfc-b83e-4812-9d0b-4076ea47633b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:14.916875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 384/770] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:14 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/e37ccc38bfcb43288a9f451428d293e0/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:35:15.034398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a9bda-e139-4ca3-a716-5d97d536d984 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.034865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a9bda-e139-4ca3-a716-5d97d536d984 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.035127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2a9bda-e139-4ca3-a716-5d97d536d984 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.036774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 385/771] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:15.042575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.042887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.043154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.051044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:15.060705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e222e4-f157-43d8-84c6-68309efb7e52 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:15.073316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:15.077203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:15.129030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:15.129563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.129836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.130101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.130763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:15.131073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:15.132471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:15.139162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 387/772] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 10:35:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:15.145605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:15.180609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 386/773] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:15.257583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e6d95-ef46-48fb-9f31-a016fe5a0dbd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:15.292521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:15.293511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.293977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.294470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.295446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] RBAC: Adding query filter params (interface=public, service_id=fa8ce7514bae4f3488b3489b1edab63c, region_id=RegionOne) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:15.295953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:15.297596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d1496-0da3-4da0-a5e5-9ca1a70eeeb9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:15.306923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 388/774] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:15 2022] GET /identity/v3/endpoints?service_id=fa8ce7514bae4f3488b3489b1edab63c&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:15.315742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:15.356572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:15.454299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196c046-d61c-470c-b39c-58d42cc4628b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:15.472012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f283-e4ec-4bb8-80f3-a75acfeb4c3b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.472353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f283-e4ec-4bb8-80f3-a75acfeb4c3b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.472595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7f283-e4ec-4bb8-80f3-a75acfeb4c3b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.474043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 389/775] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:15.479101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.479701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.480197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.493016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:15.493631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.493904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.494172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.494862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:15.496769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:15.504641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:15.506047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:15.510367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 387/776] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:15 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:15.534106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:15.597304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 390/777] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:15.642384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:15.762661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:15.773908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45170bb-6b70-4036-a90d-a10482db0071 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:15.809661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:15.810294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.810565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.810855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.821576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:15.826860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:15.827773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:15.828595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 388/778] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:15.834251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:15.937361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bc298-063b-4431-b553-5d4927fac6e1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:15.967660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:15.972332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:15.972946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:15.973330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:15.973602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:15.974313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:15.974614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:15.976025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:15.985504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 391/779] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:15.991297 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.037339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.070592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8684676-bb11-4459-b20c-89c1ff2fcc89 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.096714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52dbae-6dd2-4a36-82cb-93eec8e268db None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.104958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.105591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.105915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.106190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] PATH_INFO: `/v3/services/network` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.106826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.108189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:16.117211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:16.118219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:16.119075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 389/780] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:15 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:16.124365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.133124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.133859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.134185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.134454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.141066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.148278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.149758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:16.164640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:16.165595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:16.166464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:16.166464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:16.166464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:16.166464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 392/781] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:16.171807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.227524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4527ec-cde9-41d3-b45f-de959908a211 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.274414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.277377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.277988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.278269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.278528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a954dc-c74d-4da9-a781-a985d5a9f872 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.278635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.279224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] RBAC: Adding query filter params (name=network) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:16.279526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.281033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df3eac-38d8-4574-b538-f1ae004db264 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.286140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 390/782] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:16.291636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd912af0-cdd7-4029-a9de-ebf7ee4d21da None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.291854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd912af0-cdd7-4029-a9de-ebf7ee4d21da None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.292186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd912af0-cdd7-4029-a9de-ebf7ee4d21da None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.293702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 391/783] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:16.295382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd912af0-cdd7-4029-a9de-ebf7ee4d21da None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.315680 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.316656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.317075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.317519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.318358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:16.318865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.320408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af14123f-77d8-42f5-b886-ded960f967e5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.333138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 393/784] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:16.338936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.339569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.340012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.359055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:16.360675 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:16.377301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.401841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd912af0-cdd7-4029-a9de-ebf7ee4d21da None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.437988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.438702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.439057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.439396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.440096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] RBAC: Adding query filter params (type=network) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:16.440465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.442023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.443385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 394/785] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:16.444452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.453101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 392/786] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:16.454336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.567666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.600505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2a4b4-835a-4080-9530-b7742d7e4cae None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.629752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888d0de-f43c-4f87-9b62-f1f0081a01f1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.644276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.644886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.645161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.645428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.646126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] RBAC: Adding query filter params (interface=public, service_id=d1d433e1248c4d3e83611f1310f4b242, region_id=RegionOne) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:16.646431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.647889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.665517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 393/787] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/endpoints?service_id=d1d433e1248c4d3e83611f1310f4b242&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:16.671751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.687705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.692604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.693496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.693977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.694417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.705259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.707044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:16.724395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:16.725368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:16.726305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:16.729530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 395/788] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:16.731509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.804411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83593c-d7b0-4328-b3ed-958d453387f1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.840858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.841749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.842198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.842643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.843536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.845278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.851540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 394/789] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/services => generated 772 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:16.858722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:16.891494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8fcbf-59fa-4718-8aaa-60a419a89ce1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:16.929244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:16.929871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:16.930157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:16.930437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:16.931246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:16.931559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:16.933263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:16.936952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.962076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:16.980690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 396/790] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:16.988311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.000272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80da89-8154-4e03-b86d-26c2bb497821 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.037987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.039058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.039535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.039999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.051113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:17.056850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:17.057835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:17.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:17.061433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 395/791] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:17.068907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.126205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562748a-6d96-4e67-9c20-2121421707c3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.169094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.170076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.170550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.171064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.184398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.186167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.201181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4911-55e0-438c-b83e-d70c88645e04 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:17.206169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:17.207194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:17.208076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:17.208076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:17.208076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:17.210503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 397/792] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:17.215770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.234651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:17.243965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.244931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.245423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.245887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.246781 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:17.249001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.251441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.266856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 396/793] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:17.272177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.299489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:17.389019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913303b-e524-474e-9e09-29220db36d58 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.425771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef40a5-4586-4f2e-b3f8-398c53ab4077 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.430879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.431662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.432082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.432490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.433796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:17.434244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.436289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a66164-fe84-4edb-a3ad-c01e29f918cd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.453615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 398/794] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:17.455781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eee51e-6bbc-4e73-abbf-8aa8282a0c41 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.456208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eee51e-6bbc-4e73-abbf-8aa8282a0c41 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.456925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eee51e-6bbc-4e73-abbf-8aa8282a0c41 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.459230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 399/795] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:17.460077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eee51e-6bbc-4e73-abbf-8aa8282a0c41 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.467316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.468131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.468407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.468672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.482387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.484303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-6cb4271d-4452-48ea-8b5d-ef262e943fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:17.501509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:17.502724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:17.503700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:17.503700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:17.503700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:17.505608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 397/796] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:17.507087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.507590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.508082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.527183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:17.528709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:17.563770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:17.578379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eee51e-6bbc-4e73-abbf-8aa8282a0c41 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.578606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:17.604577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 398/797] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:17.605694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.640944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.640944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.641409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.641815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.653066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.654696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:17.678657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:17.679617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:17.680500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:17.688935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 400/798] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:17.694358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.710569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1479-709d-4580-8624-06d6af71196d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.745409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.746377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.747058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.747528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.748385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:17.748877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.750434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.762660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 399/799] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:17.771639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.826744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779edeb9-8024-497c-a6e7-6b3efefd36b5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.839092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:17.869415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.870020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.870293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.870557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.871411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:17.871713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.873131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:17.897202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 401/800] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:17.904785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:17.937470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca314f0-42b6-44ce-a263-1c110024ffbf None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:17.947046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:17.976858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:17.977735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:17.978184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:17.978596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:17.986317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:17.988031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-8db86f05-e0b0-4298-9f5c-4841fc53c6b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:18.000780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:18.001886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:18.002860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:18.005352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 400/801] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:35:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:18.006724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6332e-3551-41f1-856a-6987ded01f6f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.007178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6332e-3551-41f1-856a-6987ded01f6f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.007611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6332e-3551-41f1-856a-6987ded01f6f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.009251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 401/802] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:18.018709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c5425-5145-48cb-82da-89273defe957 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.018709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c5425-5145-48cb-82da-89273defe957 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.018709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c5425-5145-48cb-82da-89273defe957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.029447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0f9a2-31ed-4d16-8082-d2dd69fdec95 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.035268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e71c5425-5145-48cb-82da-89273defe957 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:18.042048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e71c5425-5145-48cb-82da-89273defe957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:18.064056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.064711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.064989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.065254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/c4434ebd2f9c42abaf5f1191681c9989/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.067294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=c4434ebd2f9c42abaf5f1191681c9989, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.068720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.082393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 402/803] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:17 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/c4434ebd2f9c42abaf5f1191681c9989/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:35:18.083241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.139170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 402/804] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:18.140728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c5425-5145-48cb-82da-89273defe957 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.197075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:18.207566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:18.257455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fc320-0cab-4da2-9fae-86a658518011 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.310307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.311760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.312931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.313391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.315521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:18.316080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.318542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.321790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c5425-5145-48cb-82da-89273defe957 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.363115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 403/805] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:18.368338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.379040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.379975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.380461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.380918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.392105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:18.397307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:18.398226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:18.399087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:18.401831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 403/806] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:18.411815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.521574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:18.523836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a50d5d-7f1e-4972-8164-1cfe6ace6b62 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.539269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902b38e-5785-42a4-acd6-730c7aa4a429 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.564966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:18.573688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.574327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.574605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.574912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.576934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.577748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.578211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.578666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.579568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:18.580056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.581638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.586483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.588507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.591705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 404/807] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:18.593129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:18.610076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:18.611172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:18.612036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:18.612036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:18.612036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:18.615985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 404/808] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:18.616825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.715368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e64b0b-d3fb-4ec2-8381-f1243f927b2c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.721703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796ecdf-af35-4a2c-9f4c-2f96cd97517f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.751651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.752620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.753105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.753648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.754399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.755058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.755755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.756096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.756432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.757009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:18.766649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:18.767651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 10:35:18.768561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:18.769331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.769331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.771493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 405/809] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:18.772609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:18.784431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:18.785591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:18.786460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:18.786460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:18.786460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:18.786460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 405/810] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:18.787301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.789285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:18.822381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:18.888032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e90607-2ec7-4e12-bb59-e81afabd1370 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.888234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15e31f-d234-4eb1-b53f-86092c744c9b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:18.923104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.923869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.924252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.924588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.925316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:18.925679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.926414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:18.927206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.927427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:18.927861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:18.928400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:18.929332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:18.929795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:18.931325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:18.932624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 406/811] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:18.933542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:18.944431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 406/812] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:18.945530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.022978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.053910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.057972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb67381-7f3b-44cd-ae4a-31117c23bf38 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.059019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e3bf-3f75-491c-9d83-806e3e8b8962 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.093382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.093984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.094254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.094518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.095185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:19.095480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.096254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.096838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b621466-3900-434b-a8c7-9e6af11bc16a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.096946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.097140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.097420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.098046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:19.098350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.099717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.109165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 407/813] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:19.109165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.116784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 407/814] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:19.116784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e2bcc-ac14-49fb-b95c-f06f1f1d02a5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.116784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e2bcc-ac14-49fb-b95c-f06f1f1d02a5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.116784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e2bcc-ac14-49fb-b95c-f06f1f1d02a5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.116784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 408/815] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:19.117747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e2bcc-ac14-49fb-b95c-f06f1f1d02a5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.218024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af521bd-dde9-47b2-b5f3-f3c11f142288 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.228521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e2bcc-ac14-49fb-b95c-f06f1f1d02a5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.256239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.257010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.257294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.257567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.260233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.264206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12092f4d-2e90-4ea3-9fd8-f19681b9f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.265422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12092f4d-2e90-4ea3-9fd8-f19681b9f3fe None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.266081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12092f4d-2e90-4ea3-9fd8-f19681b9f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.266446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.266581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12092f4d-2e90-4ea3-9fd8-f19681b9f3fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.267560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12092f4d-2e90-4ea3-9fd8-f19681b9f3fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.268514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.269022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12092f4d-2e90-4ea3-9fd8-f19681b9f3fe None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:19.281486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:19.282400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:19.283339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:19.288466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 408/816] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:19.291481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.301180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 409/817] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:19.302668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.303079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.303472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.324981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:19.326336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:19.337370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.411878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 410/818] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:19.412974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.429515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2788629-facd-4891-a8db-08bb23246af2 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.495250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.496034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.496405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.496765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.507324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.508765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:19.524432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:19.525624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:19.526887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:19.532999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 409/819] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:19.537062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.571003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee70e71-acbb-4ac9-b343-014d995ec438 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.618419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.619367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.619738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.620100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.621042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:19.621740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.623309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.631115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.636401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.642949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 411/820] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:19.649640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.681047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82c9b-eb07-4ab3-bb37-8b2a87a055b0 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.723445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.724096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.724326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.724595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.725346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:19.725637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.727099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.749712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 410/821] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:19.749712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.783552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaf568-4ec9-49a8-b7a4-f19139c79444 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.829243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.830321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.830841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.831372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/ee81f1a2fd8a4d0d9c6b1ae1dc418e44/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.846409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.848219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:19.866462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 412/822] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:19 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/ee81f1a2fd8a4d0d9c6b1ae1dc418e44/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:35:19.867861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:19.873433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c260e-1522-47d1-8ac8-58a9bd4562f0 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:19.910115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:19.979837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:19.980847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:19.981331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:19.987990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] PATH_INFO: `/v3/services/network` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:19.988847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:19.991392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:20.006886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:20.007935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 10:35:20.008765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:20.013842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 411/823] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:19 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:20.016479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:20.034288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.084901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5bfae-d6b1-46c9-8a1b-213b396cf967 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.128121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2c8a1-3fbe-43e2-bedc-11ee5d1313eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.129224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c8a1-3fbe-43e2-bedc-11ee5d1313eb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.129695 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c8a1-3fbe-43e2-bedc-11ee5d1313eb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.130174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2c8a1-3fbe-43e2-bedc-11ee5d1313eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.156715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ae3bc-56ee-42af-bb05-14fef06ce783 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.191734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.192402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.192681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.192951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.193632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] RBAC: Adding query filter params (name=network) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:20.193933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:20.195635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bfe1a6-af94-4675-a3f8-bbe8e35c3475 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.204922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 412/824] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:20.204922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d54a7-7e6c-448e-b1d2-a91389b047d6 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.204922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d54a7-7e6c-448e-b1d2-a91389b047d6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.204922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d54a7-7e6c-448e-b1d2-a91389b047d6 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.204922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 413/825] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:20.208960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d54a7-7e6c-448e-b1d2-a91389b047d6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.219769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2c8a1-3fbe-43e2-bedc-11ee5d1313eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:20.221228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2c8a1-3fbe-43e2-bedc-11ee5d1313eb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.271300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:20.287058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:20.337470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 413/826] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:20.337470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.337470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.337470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.354309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:20.355545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:20.358054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d54a7-7e6c-448e-b1d2-a91389b047d6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.403881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.404959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.405758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.406477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.407393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] RBAC: Adding query filter params (type=network) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:20.409582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:20.411739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.423217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 414/827] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:20.424015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.433331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 414/828] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:20.434230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.527153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:20.549454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4da95-c10c-4c3d-92a1-5c92f5f564d8 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.599290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458cc33-91a5-44e3-a32a-66923586df17 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.607445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:20.612029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.613102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.613610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.614067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.614957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:20.618969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.658850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 415/829] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:20 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:20.695590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.696650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.697138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.697595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.709413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:20.711165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.726545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:20.736887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:20.738298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:20.739256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:20.739256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:20.739256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:20.744428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 415/830] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:20.749677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.898734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccef5db-2347-4e77-909b-567cad00c228 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.911388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c1e72-7f05-46b7-880c-88c0379b9aab None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:20.938701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.939338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.939612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.939878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.942732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:20.954234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:20.954531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:20.955084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:20.955590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:20.955837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:20.956698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:20.957033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:20.958600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:20.961234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:20.962237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:20.963098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:20.971249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 416/831] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:20.972807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 416/832] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:20.977940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.978514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:20.996658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:21.108150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf2b2-e19c-4e7d-ac9a-b0df0a5180a5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.116628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8b2a7-34a5-478f-92ff-8588f13e42a2 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.155569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.156102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.156381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.156653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.157353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:21.157780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.159469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.170514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.171536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.171958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.172298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.173162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 417/833] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:21.179943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:21.190312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.193417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:21.210238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:21.215494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 417/834] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:21.216382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:21.277005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:21.282856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:21.312211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d15e0-a32c-4a26-812d-326018688dd3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.338744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89493316-f072-4467-907a-5ca937ecb0f5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.351217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.352692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.353292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.353856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.368535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.371180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.377629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.378359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.378722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.379079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.379837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:21.380204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.381690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:21.391022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:21.392014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:21.392914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:21.392914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:21.392914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:21.400026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 418/836] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:21.400195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 418/836] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:21.401384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:21.402630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:21.505234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e531a-8caf-4383-afa8-2fb80493146f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.524783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:21.537201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5e857-d5e5-4237-beb6-19e64f959491 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.543743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.544356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.544629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.544894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.545535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:21.545834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.547242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f55d0-a57c-4e8f-a95c-6ebf285aecb9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.560898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 419/837] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:21.562372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dae49-b5f9-4e32-9997-b7ed009dbbdc None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.562653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dae49-b5f9-4e32-9997-b7ed009dbbdc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.562945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7dae49-b5f9-4e32-9997-b7ed009dbbdc None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.564284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 420/838] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:21.567518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dae49-b5f9-4e32-9997-b7ed009dbbdc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:21.571397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:21.580656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.581262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.581728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.581839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.582573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=e37ccc38bfcb43288a9f451428d293e0) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:21.582956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.584385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be5ba6-7605-4f28-a6be-67da56a25038 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.599133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 419/839] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/role_assignments?user.id=e37ccc38bfcb43288a9f451428d293e0&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:21.600596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.600876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.601148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.636084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:21.638379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:21.683283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7dae49-b5f9-4e32-9997-b7ed009dbbdc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.732568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 420/840] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:21.739305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.740215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.740703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.741116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.749463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.752350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:21.763225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:21.764144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 10:35:21.765388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:21.767582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 421/841] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:21.773168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:21.880763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c7693-84a6-42b7-8d36-7d8157d23e1c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:21.902560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:21.917463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:21.918072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:21.918344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:21.918608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:21.919369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:21.919668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:21.921086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:21.943505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 421/842] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:21.949057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.002415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.002937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.070277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ae3b0-6d30-4fcb-9aa1-415136654b33 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.104016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7a84e-b88b-4fb4-96f0-ec403e32969d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.104412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c108a7-d50f-49f2-98e5-67dbd674835e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.105039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c108a7-d50f-49f2-98e5-67dbd674835e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.105373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c108a7-d50f-49f2-98e5-67dbd674835e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.105583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c108a7-d50f-49f2-98e5-67dbd674835e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.138149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.138858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.139135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.139401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.140290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.142726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-bfd02de2-820c-4233-b453-3ca018e37808 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:22.155424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:22.156439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:22.157293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 422/843] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:22.158641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee8eb1-0948-436e-9fb9-323a765066c6 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.162924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee8eb1-0948-436e-9fb9-323a765066c6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.162924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee8eb1-0948-436e-9fb9-323a765066c6 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.162924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 423/844] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:22.165145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee8eb1-0948-436e-9fb9-323a765066c6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.177427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c108a7-d50f-49f2-98e5-67dbd674835e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.179118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c108a7-d50f-49f2-98e5-67dbd674835e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.209941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.216419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.274508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee8eb1-0948-436e-9fb9-323a765066c6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.294612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 422/845] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:22.295910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871723b-678c-402f-bb30-3925b94bffea None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.296219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871723b-678c-402f-bb30-3925b94bffea None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.296475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871723b-678c-402f-bb30-3925b94bffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.313902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.314419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b871723b-678c-402f-bb30-3925b94bffea None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:22.314525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.314797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.315065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.315624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b871723b-678c-402f-bb30-3925b94bffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:22.315718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:22.316125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.317490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.326926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 424/846] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:22.328615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.393100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 423/847] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:22.394037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871723b-678c-402f-bb30-3925b94bffea None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.461325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030de37-7102-447b-91ef-0097a72a3ff1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.462138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.471078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.500622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.501329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.501671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.502005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.503387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871723b-678c-402f-bb30-3925b94bffea None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.512560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.514200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:22.530725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:22.531748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:22.532644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:22.532644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:22.532644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:22.534889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 425/848] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:22.540626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.548261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.549188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.549688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.550227 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.551105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:22.551605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.553229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.558461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 424/849] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:22.660671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420063a3-0549-46ad-8d2b-6650d51e1ee4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.683982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.698053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.698666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.698968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.699234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.699882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:22.700181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.701538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.714159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 426/850] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:22.719536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.741682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.825592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e68d4-1121-4e2e-822a-c132ad7a1125 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.836333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69a780-4273-4626-b3fc-2920768c85d8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:22.863139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:22.871191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.871823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.872095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.872360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.873765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:22.874458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:22.874766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:22.875038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:22.883819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:22.883985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:22.885450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:22.889097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:22.890322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:22.891555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 425/851] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:22.896519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:22.902465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:22.904471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:22.906152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:22.908169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 427/852] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:22.911186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.002970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:23.019066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f50e7b-91ec-4609-82de-8bd600ff105e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.028226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93472a-1977-4fbc-af6b-0cee1e9b88f0 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.061254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.062119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.062539 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.063000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.063932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:23.064451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.066251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.066588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.067234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.067511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.067775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.068725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:23.069029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.070866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.080930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 426/853] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:23.082125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.091522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 428/854] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:23.092869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.137360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:23.191805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762d9e0-b81b-4068-9da3-9b02ee64371a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.218350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fae47f-f200-4931-acb1-ca9b4f1d1b31 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.235844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.236480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.236998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.237272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.251408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.253592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.258250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.259062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.259505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.259915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.260838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=c4434ebd2f9c42abaf5f1191681c9989) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:23.261290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.263021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:23.269794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:23.270893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:23.271819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:23.271819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:23.271819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:23.272138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 429/855] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/role_assignments?user.id=c4434ebd2f9c42abaf5f1191681c9989&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:23.275146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 427/856] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:23.281915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.309688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:23.393842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586acc0-8f5d-4a44-be26-988a706dbfb7 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.434134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.435041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.435460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.435904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.436701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:23.437162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.438755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a24e1-c72f-4adf-a9c3-d396fbd85977 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.452359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 430/857] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:23.460771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.567007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240af80b-3aa8-4c2b-9ddb-1d72aa6693c8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.570435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:23.600329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c8ce1-eef0-44f4-a025-db48c4b19eba None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.600627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c8ce1-eef0-44f4-a025-db48c4b19eba None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.600871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c8ce1-eef0-44f4-a025-db48c4b19eba None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.601632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.602267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.602537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.602634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 431/858] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:23.602827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.607861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.608143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.608422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.610777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.612324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:23.626867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:23.627893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:23.629210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:23.629743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:23.629815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 428/859] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:23.629881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:23.636582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.697332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:23.715128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 432/860] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:23.759180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5347e6-b4d4-4b3e-89d6-0cf90c0f1f62 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.793525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.794400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.794862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.795274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.796149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:23.796600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:23.798251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:23.816304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 429/861] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:23.822153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:23.922373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b4ad6-9fdc-4f40-96b2-e4d26659987a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:23.958136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:23.959084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:23.959506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:23.959921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:23.990214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.016190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.034476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.046343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.048005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.105601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9d526-62d1-4830-81ff-c8d9c0db5cf3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.141894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.143106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.143595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.144247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.145122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.146844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:24.156612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:24.157557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:24.158439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:24.166069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 430/862] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:24.167262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.171633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 433/863] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:23 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:24.177482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.272376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.274779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.290187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354180f-c497-4458-8f14-af4ef4ce2cf1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.297545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a239f-d368-4dfa-908a-beb5dce300da None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.328011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.328549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.328827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.329099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.341295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.341546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.342333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.342833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.343001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.343466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.344306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:24.344998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.346980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.354729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 431/864] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:24.358722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:24.364167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:24.365311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:24.366372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:24.366372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:24.366372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:24.368116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 434/865] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:24.373307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.477122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b5312-7d4a-455d-bdeb-448912956945 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.510888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a0252-9d39-4a42-bfa4-8101310fd3e9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.513308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ba772-b09f-4722-b789-1223444e578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.513917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba772-b09f-4722-b789-1223444e578d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.514161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba772-b09f-4722-b789-1223444e578d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.514428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ba772-b09f-4722-b789-1223444e578d None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.515399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba772-b09f-4722-b789-1223444e578d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:24.515699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba772-b09f-4722-b789-1223444e578d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.517090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ba772-b09f-4722-b789-1223444e578d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.522613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 432/866] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:24.524302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235c2a7-1447-4c97-acdd-ae5b6e2b9212 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.524790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235c2a7-1447-4c97-acdd-ae5b6e2b9212 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.525395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235c2a7-1447-4c97-acdd-ae5b6e2b9212 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.527769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 433/867] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:24.533188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.533530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.533740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.554089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:24.555075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.555333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:24.556165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.556632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.557106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.558062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:24.558673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.560411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.566381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.577354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 435/868] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:24.583252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.589563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.639154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 434/869] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:24.701149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024ba12-ae02-4463-ab80-f879b3cb8f0e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.735624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.736627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.737096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.737587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.744833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.746567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:24.757936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:24.758891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:24.759770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:24.762136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 436/870] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:24.767963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.875516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f5620-ab96-4970-86d6-1c30471867ad None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:24.901358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.914759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:24.915965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:24.916437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:24.917161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:24.918431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:24.919161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:24.920923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:24.936433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 435/871] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:24.943752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:24.961419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:24.967268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:25.009808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8d98-c8b8-443f-a2b8-3f902ea905aa None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:25.046718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42627ba9-c790-4f3f-bb74-fb975beb1b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:25.047436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42627ba9-c790-4f3f-bb74-fb975beb1b1e None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:25.047785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42627ba9-c790-4f3f-bb74-fb975beb1b1e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:25.048120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42627ba9-c790-4f3f-bb74-fb975beb1b1e None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:25.048958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42627ba9-c790-4f3f-bb74-fb975beb1b1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:25.050661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42627ba9-c790-4f3f-bb74-fb975beb1b1e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:25.068340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e08405-a421-4ac4-ae63-947413c921b8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:25.074885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 437/872] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:24 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:35:25.118523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:25.119217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:25.119489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:25.119755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:25.120489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:25.120793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:25.122503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82232be7-f753-4a2c-8341-c9ca42bd62bb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:25.129949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 436/873] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:24 2022] GET /identity/v3/role_assignments?user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:25.307005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcccda8-4a8c-457a-8743-8d31c7b44da2 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:25.307327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcccda8-4a8c-457a-8743-8d31c7b44da2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:25.307563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcccda8-4a8c-457a-8743-8d31c7b44da2 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:25.309042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 438/874] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:25.314750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943730bb-dfca-4400-86bd-038541451408 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:25.315038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943730bb-dfca-4400-86bd-038541451408 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:25.315312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943730bb-dfca-4400-86bd-038541451408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:25.334961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-943730bb-dfca-4400-86bd-038541451408 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:25.336468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-943730bb-dfca-4400-86bd-038541451408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:25.395606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:25.404185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 437/875] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:25.667550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcccda8-4a8c-457a-8743-8d31c7b44da2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:25.772446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcccda8-4a8c-457a-8743-8d31c7b44da2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:25.796220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:25.808820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:25.809446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:25.809718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:25.809983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:25.810567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:25.812000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:25.820493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:25.821456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:25.822293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:25.826558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 439/876] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:25.827970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943730bb-dfca-4400-86bd-038541451408 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:25.924854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943730bb-dfca-4400-86bd-038541451408 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:25.957414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:25.958019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:25.958290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:25.958557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:25.959215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:25.959510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:25.960879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b203-5229-4d07-b6d6-7b2f20e91bda None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:25.969591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 438/877] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:25.975764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:26.080808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07578-63d6-4b41-9c6f-f78d36a5dc8d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:26.115093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:26.115708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:26.115984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:26.116306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:26.116937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:26.117234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:26.118596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119aec88-16d9-44bc-99d0-525eeb9b5a74 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:26.123580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 440/878] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:26.465287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fe69a-90e8-45c5-85b6-0bc35caa6e6a None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:26.465687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fe69a-90e8-45c5-85b6-0bc35caa6e6a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:26.465864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fe69a-90e8-45c5-85b6-0bc35caa6e6a None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:26.467421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 439/879] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:26.472703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20be0-bb71-4bed-92c5-0c20838591bc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:26.472987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20be0-bb71-4bed-92c5-0c20838591bc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:26.473260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b20be0-bb71-4bed-92c5-0c20838591bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:26.491135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-64b20be0-bb71-4bed-92c5-0c20838591bc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:26.492308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-64b20be0-bb71-4bed-92c5-0c20838591bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:26.538668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:26.560806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 441/880] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:26.819399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fe69a-90e8-45c5-85b6-0bc35caa6e6a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:26.877693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:26.919099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fe69a-90e8-45c5-85b6-0bc35caa6e6a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:26.953648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378fb07-6661-4221-85b3-fc011d58397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:26.954280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fb07-6661-4221-85b3-fc011d58397f None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:26.954556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fb07-6661-4221-85b3-fc011d58397f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:26.954854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378fb07-6661-4221-85b3-fc011d58397f None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:26.955511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378fb07-6661-4221-85b3-fc011d58397f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:26.956907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378fb07-6661-4221-85b3-fc011d58397f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:26.977006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 440/881] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:26 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:27.128853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209786d-3c74-44a1-b6ab-d591fea0428d None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.129346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209786d-3c74-44a1-b6ab-d591fea0428d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.129346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209786d-3c74-44a1-b6ab-d591fea0428d None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.130810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 442/882] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:27.136000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.136285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.136552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.156354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:27.157551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:27.190947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a992-1c61-4af1-a1d1-55ad91fdf620 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.191281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a992-1c61-4af1-a1d1-55ad91fdf620 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.191505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a992-1c61-4af1-a1d1-55ad91fdf620 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.193245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 443/883] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:27.198203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.198509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.198791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.216551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:27.217746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:27.236952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 441/884] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:27.292254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 444/885] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:27.523169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:27.558538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:27.569075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:27.635247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03884-e2d3-40e8-9607-facf2a9616fe None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:27.671314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3e247-66f8-4f0c-afb4-7378d1ee9c09 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:27.679193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:27.679841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.680116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.680382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.680970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:27.683028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:27.688096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:27.696544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:27.697520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:27.698541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 442/886] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:27.703668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:27.715507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:27.716427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.716904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.717372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.728398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:27.733395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:27.734338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:27.735327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:27.742620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 445/887] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 10:35:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:27.744044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:27.824967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307e08c-890c-45d5-937d-ee6390fa285f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:27.837665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:27.864700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:27.865363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356da6ed-a351-4fa4-b079-b9d22273683c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:27.865550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.866089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.866478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.867257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:27.867742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:27.869413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:27.874587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 443/888] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:27.880461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:27.905110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:27.905722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:27.906000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:27.906268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:27.907001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:27.907352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:27.908866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:27.917958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 446/889] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:35:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:27.923234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:27.957824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:27.994323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08509001-689c-4015-85dc-66b6928f35ad None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.030726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd61bd-b94b-4733-8482-8f1c492aefcd None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.032967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.034328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.034328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.034328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.035156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:28.035522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.036972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.047145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 444/890] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:28.051674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.075145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.076045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.076604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.077085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.088547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.090348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.091360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-8f1230f9-58a2-49ae-adee-c75c51512eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:28.109745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:28.111124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:28.112018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:28.112018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:28.112018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:28.112018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 447/891] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:28.112498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c028d-abaa-4e9a-aa3a-ebc46d8c6f88 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.112872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c028d-abaa-4e9a-aa3a-ebc46d8c6f88 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.113137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c028d-abaa-4e9a-aa3a-ebc46d8c6f88 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.114501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 448/892] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:28.119355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c028d-abaa-4e9a-aa3a-ebc46d8c6f88 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.161697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f709-a50d-4185-b2b6-8637cbb6cb28 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.197374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.198003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.198283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.198550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.199331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] RBAC: Adding query filter params (interface=public, service_id=bb3bc89eff514ab595b1581eae2b48a8, region_id=RegionOne) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:28.199661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.201081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda9d15-c491-436d-9bc7-381429e0d040 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.206205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 445/893] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:28 2022] GET /identity/v3/endpoints?service_id=bb3bc89eff514ab595b1581eae2b48a8&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:28.207502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.207788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.208058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.216997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:28.226132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:28.227407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:28.234853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c028d-abaa-4e9a-aa3a-ebc46d8c6f88 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.271083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.271794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.272071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.272368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.273087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:28.273392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.274783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.291496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 449/894] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:28.298797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 446/895] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:28.298925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.299005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.324908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:28.396933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed356416-24cb-43de-aa47-35b9ad333fc6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.432594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.433229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.433494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.433804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.436118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc749a-0c3a-48bc-babd-72e366094d4c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.442848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.444319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:28.457915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:28.458956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:28.459901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:28.463044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 447/896] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:35:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:28.464932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.485006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.485952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.486466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.486966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.488334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.490467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.499052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 450/897] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:28 2022] GET /identity/v3/services => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:35:28.570959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:28.584145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.584911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d4f85-60f7-4c43-b628-173fbbb81c72 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.598308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:28.625365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.626509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.627038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.627506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.628562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:28.629096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.630823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.650861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 448/898] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 10:35:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:28.656476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:28.705618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47319f3a-dd06-4e58-b085-cf57aa98dbfa None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.749833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a6233-c9dc-41a2-af8c-e136a39f2130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.750847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6233-c9dc-41a2-af8c-e136a39f2130 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.751769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6233-c9dc-41a2-af8c-e136a39f2130 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.752262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a6233-c9dc-41a2-af8c-e136a39f2130 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.753387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a6233-c9dc-41a2-af8c-e136a39f2130 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.755814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a6233-c9dc-41a2-af8c-e136a39f2130 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.763376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb52957-1b7b-4d3e-aa6c-992713897c9a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:28.776035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 451/899] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:28 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:35:28.816868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:28.817586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.817937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.818277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.836912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:28.914398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:28.915819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:28.943833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72405dd6-7f8d-4bde-ad60-05e860f1b42b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.944152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72405dd6-7f8d-4bde-ad60-05e860f1b42b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.944387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72405dd6-7f8d-4bde-ad60-05e860f1b42b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.945757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 452/900] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:28.951481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:28.951481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:28.951481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:28.970717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:28.971935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:29.035656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 449/901] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 10:35:29.044406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.050553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:29.062843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 453/902] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:29.093739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:29.149683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27969-ca06-4dde-877b-70c36e7f97db None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.185199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.185809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.186092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.186359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.196848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.198301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:29.217804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:29.218982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:29.219881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:29.219881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:29.219881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:29.219881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 450/903] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:29.224800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.328903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274f70c-06ac-40a1-a7b5-b6443532f051 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.339082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.364794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.365418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.365685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.365955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.366606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:29.366986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.368452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.380447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 454/904] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:29.385915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.443141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:29.449121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52c41-722b-407d-9c09-dab2897fe3ee None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.451074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:29.483919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.484839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.485285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.485721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.486507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.488174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:29.497318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:29.498259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:29.499260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:29.501986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 451/905] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:29.502841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e8329-2df1-488a-a11d-e3c05e3a2fab None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.507574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.544465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.545913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.546204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.546475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.554946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.556696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:29.573011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:29.573920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:29.574831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:29.578770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 455/906] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:29.581007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.632537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139199-00d3-4c3c-ad58-8b4e7a64ce72 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.675474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.676409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.676902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.677359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.678172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:29.678659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.680295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.685791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 452/907] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:29.694799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.709001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c8f9f-5a1e-4ea4-8d37-fb79841d7491 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.718274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:29.738820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:29.757344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.758821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.759502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.759967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.761059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:29.761909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.764147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.786525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 456/908] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:29.786941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.813914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa9555-d1a5-4d16-8a56-f728924f5693 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.850388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.850992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.851268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.851540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.852226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:29.852548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.854089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.864599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 453/909] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:29.866208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:29.922999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc1fcf-3084-4115-94de-d7207338c7d4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:29.960105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:29.960628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:29.960907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:29.961178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:29.962018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] RBAC: Adding query filter params (role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:29.962200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:29.963672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:29.971194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 457/910] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/role_assignments?user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:29.984405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:30.022850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232fdb3-6bdd-465e-be33-e9af0c493fcd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:30.062414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:30.063079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.063358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.063626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.064341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] RBAC: Adding query filter params (interface=public, service_id=4e6edb456fb74ad0ae58e6d02800b6bc, region_id=RegionOne) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:30.064690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:30.066256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ca219-11f0-4901-a0ab-118b45b6e1a6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:30.077044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 454/911] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:29 2022] GET /identity/v3/endpoints?service_id=4e6edb456fb74ad0ae58e6d02800b6bc&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:30.078538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:30.130653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:30.188893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d98d9c-0558-4b06-bc9e-9478e2317adb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:30.224042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f39eca-14f4-4c85-8275-f1a58df1d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:30.224570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39eca-14f4-4c85-8275-f1a58df1d23f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.224851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39eca-14f4-4c85-8275-f1a58df1d23f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.225377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f39eca-14f4-4c85-8275-f1a58df1d23f None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.225728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f39eca-14f4-4c85-8275-f1a58df1d23f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:30.227137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f39eca-14f4-4c85-8275-f1a58df1d23f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:30.233558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 458/912] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:30 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:35:30.441472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03cce4-fc6d-4dee-9242-39efe8ced4a6 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.441839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03cce4-fc6d-4dee-9242-39efe8ced4a6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.442040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03cce4-fc6d-4dee-9242-39efe8ced4a6 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.443587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 455/913] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:30.448854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04b69-9fd5-4c4b-8e21-5bb1c248f054 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.449137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04b69-9fd5-4c4b-8e21-5bb1c248f054 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.449408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f04b69-9fd5-4c4b-8e21-5bb1c248f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.467937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e6f04b69-9fd5-4c4b-8e21-5bb1c248f054 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:30.469109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e6f04b69-9fd5-4c4b-8e21-5bb1c248f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:30.547378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 459/914] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:30.809917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03cce4-fc6d-4dee-9242-39efe8ced4a6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:30.864380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67c004-3ce7-4175-b498-1beac93861ef None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.864685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67c004-3ce7-4175-b498-1beac93861ef None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.864934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67c004-3ce7-4175-b498-1beac93861ef None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.866520 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 460/915] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:30.871759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.872049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.872324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.892481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:30.894048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:30.920464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03cce4-fc6d-4dee-9242-39efe8ced4a6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:30.925759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:30.960220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:30.960870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:30.961123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:30.961391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:30.961973 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:30.966435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:30.974799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 461/916] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:30.975529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:30.976549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:30.977494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 456/917] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:30.984351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.090360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af852f-6ff3-4ea1-8907-2b7eb2c3057e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.125306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.125912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.126184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.126455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.127117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:31.127414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.128811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.133737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 462/918] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:31.143767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.162693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:31.244095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8a19b-d3e7-4ef7-ac7a-583ef26e650c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.246013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.282559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.283178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.283449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.283751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.284381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:31.284850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.286307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.290080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:31.292400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 457/919] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 10:35:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:31.297756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.383402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:31.392567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7617-0f7a-4d67-aca2-8d48f821c222 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.405910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd49b00-b1cb-49fb-a69b-0da1f99dd40a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.439209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.440347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.440872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.441329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.441580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.442250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.442495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.442611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.442964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.443694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.444548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.445166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:31.456369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:31.457708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:31.458561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:31.463154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 463/920] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:31.464111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.478931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 458/921] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:31.577008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:31.585502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684345a-483a-4a52-8923-e89eddc4f599 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.631154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.632219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.632709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.633193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.634084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:31.634583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.636169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.641668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 464/922] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:31.647820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.754103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4041f30e-ad29-4ee9-9b7f-afa87749511a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.792139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.792748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.793023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.793289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.793921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:31.794217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.795624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685dd6dc-d8fe-478f-8e23-bc2120d227c0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.797802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:31.801000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 459/923] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:31.807167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.913169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e259af-270c-4923-8c6e-e82bb7268808 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:31.918182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40761-099d-431f-8ae2-e0b829d5697e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.918458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40761-099d-431f-8ae2-e0b829d5697e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.918755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae40761-099d-431f-8ae2-e0b829d5697e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.920337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 460/924] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:31.925207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c17ee-eefe-4ba7-96ca-09a6f470a918 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.925486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c17ee-eefe-4ba7-96ca-09a6f470a918 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.925755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c17ee-eefe-4ba7-96ca-09a6f470a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.944497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5f8c17ee-eefe-4ba7-96ca-09a6f470a918 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:31.945775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5f8c17ee-eefe-4ba7-96ca-09a6f470a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:31.950658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:31.951313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:31.951574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:31.951841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:31.952535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] RBAC: Adding query filter params (interface=public, service_id=7b14d60ed70c483ea06526e4932e39fa, region_id=RegionOne) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:31.952839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:31.954600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:31.961712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 465/925] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:31 2022] GET /identity/v3/endpoints?service_id=7b14d60ed70c483ea06526e4932e39fa&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:31.967252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:31.993118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:32.038882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 461/926] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:32.080603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300a9d7-b9e2-419f-9caf-1115e4b9f76c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:32.114223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae749d-27f5-402b-beca-b3f0e886867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:32.114858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae749d-27f5-402b-beca-b3f0e886867d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.115134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae749d-27f5-402b-beca-b3f0e886867d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.115402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae749d-27f5-402b-beca-b3f0e886867d None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.116008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae749d-27f5-402b-beca-b3f0e886867d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:32.117354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae749d-27f5-402b-beca-b3f0e886867d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:32.123555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 466/927] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:31 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:35:32.159734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c746-c8b4-4352-af55-c97266b42513 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.160696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c746-c8b4-4352-af55-c97266b42513 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.161170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442c746-c8b4-4352-af55-c97266b42513 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.163095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 462/928] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:32.170818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.170818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.170818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.188675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:32.189907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:32.264885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 467/929] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:32.325610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c746-c8b4-4352-af55-c97266b42513 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:32.428374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442c746-c8b4-4352-af55-c97266b42513 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:32.457501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:32.463702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:32.464607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.465112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.465567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.478004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:32.485655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:32.486874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:32.487836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:32.491880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 463/930] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:32.498574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:32.515267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:32.534701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:32.639460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e39363-5040-4f04-8cee-d508e7f53f73 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:32.658798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248d7bb-68f6-4e65-8419-0082ca5e5da8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:32.688981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:32.689899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.690435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.690765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.691754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:32.692062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:32.694213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:32.697271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:32.697981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.698322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.698654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.699333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:32.700753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:32.703929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 468/931] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:32.709672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:32.710591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:32.711533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 464/932] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:32.718724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:32.718908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:32.783911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:32.796562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:32.820419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3b95d-7ee5-4745-8962-624d29e2bb0c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:32.835782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db2078-ec33-44fa-97c9-1974e9c68f22 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:32.854699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:32.855300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.855575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.855840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.874060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:32.875730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:32.877056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:32.878057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:32.878900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:32.879501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:32.880338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:32.880835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:32.882387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:32.889176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 465/933] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:32.893228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:32.894181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:32.895124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:32.895124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:32.895124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:32.896176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 469/934] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:32.896725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:32.901210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.002180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb447e-235c-4c53-9058-579851472369 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.019865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d079e-ca4c-4632-ac3f-204cd6c7a249 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.021103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:33.040891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.041655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.042029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.042393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.043695 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:33.044130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.045883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.051595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:33.058731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 466/935] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:33.060299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.062628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.063542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.064174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.064647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.065518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:33.066124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.067832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.085844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 470/936] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:33.087130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.160854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea89c1-486d-4b3f-9cc3-29aff05c773f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.196445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.197057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.197333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.197602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.198263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.199678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.202600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247643ca-8d72-4e4d-a16e-242275e1c714 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.231002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 467/937] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:35:33.251370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.252467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.253004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.253565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.262643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.264590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:33.278585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:33.280093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:33.281053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:33.283991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 471/938] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:35:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:33.290492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.335196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:33.406262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946a8cd-7917-43bf-92ff-26856642ff14 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.440384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.441401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.441871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.442345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.443361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:33.443855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.445531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186861e-78a8-4d86-9e32-b5a6163580fd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.463940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 468/939] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 10:35:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:33.469802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.488758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458812-468b-429a-b75b-e32a6da5793a None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.489169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458812-468b-429a-b75b-e32a6da5793a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.489530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458812-468b-429a-b75b-e32a6da5793a None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.491297 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 469/940] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:33.502166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.502914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.503048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.524617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:33.526432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:33.528325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:33.589359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50772d1-1323-4e67-a637-41391cc1a762 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.622334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 470/941] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:33.635284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.636203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.636625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.637057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.649026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.650672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:33.665447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:33.666607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:33.667767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:33.667767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:33.667767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:33.669468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 472/942] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:33.675065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.702984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:33.779969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab6f1c-a96e-45e1-b404-51f516de3f9d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.814664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.815438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.815873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.816340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:33.817101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:33.817494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:33.818986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:33.830990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 471/943] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:33.836268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.910517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:33.939790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:33.946853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6efc1a-d0fd-4924-912b-573576041250 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:33.993095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:33.993992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:33.994429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:33.994870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.003986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.006165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.016006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:34.023295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:34.024221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:34.025107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 473/944] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:34.031736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:34.040597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423bba4-2c1a-4c51-b2a6-ee801582f285 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.085998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.086618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.086938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.087209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.087870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.089303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.092923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING keystone.server.flask.common [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 10:35:34.116962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.sql.core [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 10:35:34.116962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 10:35:34.116962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [parameters: {'id': '8ef920d19322442fa4bd42967f8bb832', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 10:35:34.116962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-4d430573-19ea-4922-a442-7a167013fd15 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ef920d19322442fa4bd42967f8bb832.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ef920d19322442fa4bd42967f8bb832. Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:35:34.123765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result.read() Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 12 10:35:34.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application yield resource Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise self.value Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application session.commit() Aug 12 10:35:34.125901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.session.flush() Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application compat.raise_( Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 10:35:34.127020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 10:35:34.128101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application result.read() Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:35:34.129084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [parameters: {'id': '8ef920d19322442fa4bd42967f8bb832', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.130084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:34.131767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8ef920d19322442fa4bd42967f8bb832. Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 472/945] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Aug 12 10:35:33 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b196ce-d2eb-4093-a442-b3200cbd4bc5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.134071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b196ce-d2eb-4093-a442-b3200cbd4bc5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.135505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b196ce-d2eb-4093-a442-b3200cbd4bc5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.138727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 473/946] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:34.138727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b196ce-d2eb-4093-a442-b3200cbd4bc5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:34.153113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634aa0f6-fd9b-4a1f-aead-9366cff9d08d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.190322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.190977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.191247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.191510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.192197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:34.192495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.193978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97aa445-4fad-4c9c-9bbb-e66d5e2a2209 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.210731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 474/947] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:34.211983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.212261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.212543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.229973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:34.231171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:34.241898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:34.249655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b196ce-d2eb-4093-a442-b3200cbd4bc5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.288083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.288715 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.288987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.289259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.296045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.297608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.300554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 475/948] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:34.301390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:34.312866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:34.313800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:34.314770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:34.322992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 474/949] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:34.323713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:34.329012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:34.438493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bf3ee-796f-4bbe-a9ab-15f4ab6cb957 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.463760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ab17-e66c-4227-bc3e-f6907af2e4ac None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.481544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.482853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.483199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.483541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/ee81f1a2fd8a4d0d9c6b1ae1dc418e44/roles/2888c1e8c9ff4cb8a455a91c0b0f60bb` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.486288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44, role_id=2888c1e8c9ff4cb8a455a91c0b0f60bb)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.488226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.506605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.507130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 476/950] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:34 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/ee81f1a2fd8a4d0d9c6b1ae1dc418e44/roles/2888c1e8c9ff4cb8a455a91c0b0f60bb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:35:34.507640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.508159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.508433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.509101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:34.509401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.515403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.542850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 475/951] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:34.571885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:34.585369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:34.706060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f03f6-8ff2-4d83-857c-56159faabd7c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.744144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.744779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.745119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.745390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.745974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.747753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:34.756308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:34.757499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:34.758513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 477/952] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:34.765716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:34.832286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:34.879161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764bf1a-a495-43a3-bf87-daa5ba78491b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:34.914976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:34.915586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:34.915862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:34.916126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:34.916749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:34.917044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:34.918413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:34.923742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 476/953] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:34.929772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:35.012972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:35.045624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c2950-7709-4aa6-a916-7dd9ec2d8376 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:35.081740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:35.082406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:35.082623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:35.082922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:35.083557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:35.083856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:35.085279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb3b8b-6be4-4628-b6a7-a57b52d5a271 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:35.090751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 478/954] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:35.096320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:35.211762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884626-e36f-443e-ac9a-20b83d819f1c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:35.241022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:35.249947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:35.250586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151795d7-477a-4d58-be87-d170af5f1322 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:35.250586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151795d7-477a-4d58-be87-d170af5f1322 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:35.250783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:35.250857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151795d7-477a-4d58-be87-d170af5f1322 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:35.250942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:35.251191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:35.251792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:35.252313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 479/955] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:35.253221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:35.257728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:35.257951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:35.258586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:35.281134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:35.282339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 477/956] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:35.286755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:35.370750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 480/957] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:35.631184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:35.737276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d897aa-54b6-480c-b8af-315ade540fc7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:35.772487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:35.773124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:35.773400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:35.773671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:35.774256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:35.775656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:35.784454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:35.785516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:35.786398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:35.790495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 478/958] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:35.791894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:35.851121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:35.895245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8dc6d-4cc1-483c-bf99-083e36bc2d99 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:35.937695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:35.938873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:35.939374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:35.939845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:35.940703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:35.941328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:35.942918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534cc79-6167-4e85-a01c-3efbf42f92b2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:35.948611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 481/959] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:35.955952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:36.002608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:36.059036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d66595-76eb-4cb8-b0f5-1d0b1bb692d4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:36.097072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:36.097681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:36.097959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:36.098233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:36.098896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:36.099199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:36.100576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947495df-57ae-464b-a572-a99a681a0691 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:36.105515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 479/960] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:36.498857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aded6b-a69d-43b3-b9bb-76e856009b24 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:36.499416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aded6b-a69d-43b3-b9bb-76e856009b24 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:36.499416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aded6b-a69d-43b3-b9bb-76e856009b24 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:36.500970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 482/961] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:36.506053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ffdef-ffbb-4e28-b3fc-ac7568c72793 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:36.506437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ffdef-ffbb-4e28-b3fc-ac7568c72793 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:36.506597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ffdef-ffbb-4e28-b3fc-ac7568c72793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:36.525451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ba2ffdef-ffbb-4e28-b3fc-ac7568c72793 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:36.526973 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ba2ffdef-ffbb-4e28-b3fc-ac7568c72793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:36.598428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 480/962] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:36.733779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdad0ce-e69a-4310-9ef9-9b4e76529f64 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:36.734149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdad0ce-e69a-4310-9ef9-9b4e76529f64 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:36.734352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdad0ce-e69a-4310-9ef9-9b4e76529f64 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:36.735942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 483/963] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:36.741328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:36.741850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:36.742318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:36.763787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:36.764901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:36.800797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:36.834971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 481/964] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:36.876383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdad0ce-e69a-4310-9ef9-9b4e76529f64 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:36.986220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdad0ce-e69a-4310-9ef9-9b4e76529f64 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.010847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:37.023427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.024358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.024837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.025324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.036278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:37.041276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:37.042208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:37.043077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.045670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 484/965] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 10:35:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:37.051449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.121789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.153449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aae8b-e688-44da-b0ae-4fc01081dadd None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.191628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.192617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.193125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.193583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.194439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:37.194954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.196508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.205380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 482/966] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:37.214031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.235313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e340-f713-46fd-932d-440c20dbf44f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.254413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:37.272930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.273591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.273820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.274095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.274779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.276241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.278872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING keystone.server.flask.common [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 10:35:37.292362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.sql.core [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 10:35:37.292362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 10:35:37.292362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [parameters: {'user_id': 'd86e5807c4f547deb2657c9237fed7ea', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 10:35:37.292362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93274) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-f484cfec-adf4-4ab9-ae3e-55e693480264 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application result.read() Aug 12 10:35:37.310289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:35:37.311490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application yield resource Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application next(self.gen) Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise self.value Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application session.commit() Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 10:35:37.312436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self.session.flush() Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application compat.raise_( Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 10:35:37.313358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 10:35:37.314253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application conn.query(q) Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application result.read() Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 10:35:37.319537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd86e5807c4f547deb2657c9237fed7ea', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:37.320410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 12 10:35:37.321264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 485/967] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 10:35:37 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b8b6-c325-49a1-8b9e-3bf68c97ce34 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b8b6-c325-49a1-8b9e-3bf68c97ce34 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.322171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b8b6-c325-49a1-8b9e-3bf68c97ce34 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.324206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 486/968] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:37.325046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96b8b6-c325-49a1-8b9e-3bf68c97ce34 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.342996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02eb52-6caf-4040-805c-ac97f254e5cf None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.376809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:37.381027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.381966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.382304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.382513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.396462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.398509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-37b74ea2-c150-4ae3-ae84-471cd88e8782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:37.413192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:37.414158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:37.415562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:37.415562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:37.415562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:37.415562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 483/969] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:37.415562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279497d8-672d-4051-a69e-eea1971346fc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.415856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279497d8-672d-4051-a69e-eea1971346fc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.416101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279497d8-672d-4051-a69e-eea1971346fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.434387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-279497d8-672d-4051-a69e-eea1971346fc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:37.435829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-279497d8-672d-4051-a69e-eea1971346fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:37.439757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96b8b6-c325-49a1-8b9e-3bf68c97ce34 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.475850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.476803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.477270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.477763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.485076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.486621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:37.498036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:37.499501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 487/970] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:37.500429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.508242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 484/971] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:37.509092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279497d8-672d-4051-a69e-eea1971346fc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.528401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:37.617288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279497d8-672d-4051-a69e-eea1971346fc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.634727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d0ee4-9eaa-442f-a384-a0f7de5fa797 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.644603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:37.654091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.654747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.655029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.655322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.656012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:37.656317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.657822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.677971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.679062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.679546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.680007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.680847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:37.681353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.683806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.701033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 485/972] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:37.701691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 488/973] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:37.702738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.775211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.810637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:37.821564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc56e-a4eb-4b70-9c20-752b0df9eeac None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.862137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.863288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.863677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.864038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.872838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.874395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:37.888510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:37.889531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:37.891054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 486/974] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:37.897732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:37.906212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91378e73-d879-4a54-8b2a-05d37e538b8a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:37.957590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:37.958421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.958823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.959188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.960419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:37.962040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a9a9fd04-6956-4406-bc2c-d4dc3dc65780 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:37.977913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:37.979264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:37.980233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:37.981120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 489/975] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:37.990508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce57ec-cf75-4f9d-a109-504690e8e750 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:37.990919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce57ec-cf75-4f9d-a109-504690e8e750 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:37.991306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce57ec-cf75-4f9d-a109-504690e8e750 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:37.993047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 490/976] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:37.993845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce57ec-cf75-4f9d-a109-504690e8e750 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.025346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.026301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f17f51-44d7-4e4b-8fc4-fd295f208702 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.055584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.061793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.062334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.062604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.062893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.063621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:38.063916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.065321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb993-7079-4a71-9ecc-6dce640d7b28 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.082956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 487/977] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:38.084217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.084558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.084894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.099177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce57ec-cf75-4f9d-a109-504690e8e750 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.102549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:38.103801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:38.133509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.134115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.134396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.134668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.135328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:38.135634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.136993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.142040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 491/978] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:38.142916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.173574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 488/979] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:38.174408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.245960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.253308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa35e1-4d33-4d91-aef8-96763a12e2e7 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.277727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b802c96-312e-4117-852c-d7915ad2bbc1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.287969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.288578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.288850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.289116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.298519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.313287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.313824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.314097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.314437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.315025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:38.315325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.316970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.322030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 489/980] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:38.328222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.363724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.365156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.430428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb86f2-0bb9-4c5a-abe6-18978c92964c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.457964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.465770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 492/981] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:38.465905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.466437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.466556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.466748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.467069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.467784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] RBAC: Adding query filter params (interface=admin, service_id=7b14d60ed70c483ea06526e4932e39fa, region_id=RegionOne) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:38.468092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.469452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.474875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 490/982] 10.222.0.26 () {56 vars in 1249 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/endpoints?service_id=7b14d60ed70c483ea06526e4932e39fa&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:38.475699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.523949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.565674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67b3e1-82d4-4e88-a721-91f3774308bb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.573598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a5128-aa5c-45d7-8ba7-6696d90476f7 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.598812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.599407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.599680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.599948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.600587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.601938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.608485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.609091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.609409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.609662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.616929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 493/983] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:38 2022] POST /identity/v3/services => generated 242 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:38.617723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.620844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.622306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:38.640578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:38.641796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:38.643000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:38.643000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:38.643000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:38.646717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 491/984] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:38.647852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.693031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.750009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ff9f9-44ca-4a62-b796-b7760576a03f None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.761521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.764642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9e677-7b0b-421c-9707-3aaf638a2512 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.792197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.792809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.793085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.793354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.793952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.795506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.801935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 494/985] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:35:38.806928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.807608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.807892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.808162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.808838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:38.809138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.810549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:38.829143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 492/986] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:38.830473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:38.949961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b4ef0-ea57-4a8c-9c0a-b61b3377db77 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:38.965238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:38.989296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:38.990042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:38.990422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:38.990824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:38.998084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:38.999687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:39.011968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:39.013335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:39.014713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:39.021830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 495/987] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:39.023127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:39.129504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74305ca5-14a8-4c06-bda3-75c9ee7479ff None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:39.164389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:39.164999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:39.165278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:39.165544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:39.166236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:39.166537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:39.168083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e8edc-ea55-467c-b601-ed15c938d1d6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:39.184517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 493/988] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:39.185921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:39.288184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c03fc2-6435-491d-9184-a753c001f581 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:39.321703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:39.322301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:39.322580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:39.322944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:39.323642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] RBAC: Adding query filter params (role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:39.323951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:39.325385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e209675-ddc6-4824-8e04-359f209b26af None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:39.332138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 496/989] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:39 2022] GET /identity/v3/role_assignments?user.id=ee81f1a2fd8a4d0d9c6b1ae1dc418e44&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:40.501337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045642a-fa5f-40e1-b38c-6c0375c0f90a None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:40.501918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045642a-fa5f-40e1-b38c-6c0375c0f90a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:40.501918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045642a-fa5f-40e1-b38c-6c0375c0f90a None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:40.503471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 494/990] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:40.508587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf806f6f-f488-4943-a5a0-304375ec43b4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:40.508997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf806f6f-f488-4943-a5a0-304375ec43b4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:40.509135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf806f6f-f488-4943-a5a0-304375ec43b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:40.528506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bf806f6f-f488-4943-a5a0-304375ec43b4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:40.530031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bf806f6f-f488-4943-a5a0-304375ec43b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:40.562474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:40.602321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 497/991] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:40.676645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee791cc-b339-4c29-8662-45ac7aff5d50 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:40.676971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee791cc-b339-4c29-8662-45ac7aff5d50 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:40.677156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee791cc-b339-4c29-8662-45ac7aff5d50 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:40.678712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 495/992] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:40.683732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:40.684018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:40.684258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:40.702589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:40.703796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:40.771621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 498/993] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:40.860046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee791cc-b339-4c29-8662-45ac7aff5d50 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:40.885241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:40.977750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee791cc-b339-4c29-8662-45ac7aff5d50 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.013931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.014555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.014865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.015446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] PATH_INFO: `/v3/services/compute` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.016022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.017382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:41.026099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:41.027170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:41.028521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:41.031040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 496/994] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:41.032960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.038538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.125295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:41.136999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:41.141623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5c396-f201-4ccb-b936-99826d670441 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.143207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a82291-623f-477c-8e6a-8cc72541502f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.178938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.179223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.179708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.179856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.180062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.180166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.180333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.180496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.180961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] RBAC: Adding query filter params (name=compute) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:41.181237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.181335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.182614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.182763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.187687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 499/995] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:41.192215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:41.193465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 10:35:41.195077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:41.195972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.196072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 497/996] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:41.200777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.297387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd7fa7-9004-4e02-9e86-581f168dc72b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.299872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c76f8-4911-4be9-9f11-fef9ed69645e None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.329548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.330281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.330554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.330843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.331505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] RBAC: Adding query filter params (type=compute) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:41.331795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.333027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.333155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd2fb5-f54d-40af-82fb-9ad18231da1c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.333626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.333899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.334255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.334837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:41.335153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.336498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e72a2e-5bb4-4724-9b07-9fb7121b055d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.337830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 500/997] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:41.339051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4af450-c9c7-42fe-b914-e609bb534a80 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.339337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4af450-c9c7-42fe-b914-e609bb534a80 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.339588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4af450-c9c7-42fe-b914-e609bb534a80 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.344684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 501/998] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:41.344818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 498/999] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:41.347083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4af450-c9c7-42fe-b914-e609bb534a80 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.347550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.347825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.348091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.365372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:41.366544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:41.373902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:41.374028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:41.431517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 499/1000] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:41.432532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.452794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4af450-c9c7-42fe-b914-e609bb534a80 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.489569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.490171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.490445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.490740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.491435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] RBAC: Adding query filter params (interface=public, service_id=d6654b0ee0d64c0a88549a4a405902b0, region_id=RegionOne) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:41.491736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.493112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.498419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 502/1001] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/endpoints?service_id=d6654b0ee0d64c0a88549a4a405902b0&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:41.503853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.532529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528d512-357b-4f15-b62a-3de59bdf65db None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.571956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.572906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.573563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.573993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.574827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:41.575257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.576927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.582436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 500/1002] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:41.588092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.596576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:41.610728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:41.621390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3066a42-827c-4e94-95e3-8b5632c2a024 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.656288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.656881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.657155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.657421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.658021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.659425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.665556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 503/1003] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:35:41.691770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aca406-b83b-45bf-a1de-aa83224ab005 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.699928 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.731358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.731951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.732228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.732496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.733170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.734584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.753529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 501/1004] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:35:41.821361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33e7b-64f8-4d8c-9564-6907a2664571 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:41.869919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:41.870469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:41.870775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:41.871045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] PATH_INFO: `/v3/services/image` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:41.871640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:41.873017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:41.882966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:41.884007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:41.884857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 504/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:41.890858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:41.969393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:42.009486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0e1d9-0991-44f8-8d26-a9b787c0948a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:42.044347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:42.044958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:42.045199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:42.045491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:42.046116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] RBAC: Adding query filter params (name=image) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:42.046388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:42.047955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23cc44-86a3-4889-a8c2-569e9ac74c70 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:42.052981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 502/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:42.058705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:42.076660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:42.168227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc47007-7b10-40c8-b641-7c50a8b3e7fa None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:42.203324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:42.203929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:42.204204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:42.204475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:42.205101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] RBAC: Adding query filter params (type=image) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:42.205400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:42.206886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2652948b-6d12-457e-8650-5593fd362311 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:42.211752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 505/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:43.547251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69729f8-ed45-4f55-b3d1-ec0823da54af None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:43.547779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69729f8-ed45-4f55-b3d1-ec0823da54af None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:43.547779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69729f8-ed45-4f55-b3d1-ec0823da54af None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:43.549407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 503/1008] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:43.554668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50ca4-49d2-47bf-8e7f-4bc2062f9d19 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:43.555110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50ca4-49d2-47bf-8e7f-4bc2062f9d19 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:43.555299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c50ca4-49d2-47bf-8e7f-4bc2062f9d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:43.573488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-66c50ca4-49d2-47bf-8e7f-4bc2062f9d19 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:43.574653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-66c50ca4-49d2-47bf-8e7f-4bc2062f9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:43.644794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 506/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:43.657166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30518367-c493-4848-9e60-aaff80fd7db9 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:43.657449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30518367-c493-4848-9e60-aaff80fd7db9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:43.657723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30518367-c493-4848-9e60-aaff80fd7db9 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:43.659210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 504/1010] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:43.664199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:43.664486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:43.664761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:43.683242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:43.684411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:43.686348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:43.754521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 507/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:43.904608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30518367-c493-4848-9e60-aaff80fd7db9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.014700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.030815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30518367-c493-4848-9e60-aaff80fd7db9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.061030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:44.068385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.069022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.069296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.069559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] PATH_INFO: `/v3/services/compute` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.070140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.071902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-c8f04065-e3b8-4dac-aed5-706d0c4df33c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:44.081260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:44.082306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:44.083215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 505/1012] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:44.088939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885843a-d0a3-44e2-828e-951c279424d5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.089225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885843a-d0a3-44e2-828e-951c279424d5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.089496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885843a-d0a3-44e2-828e-951c279424d5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.090777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 506/1013] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:44.091446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885843a-d0a3-44e2-828e-951c279424d5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.136170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63ee44-305b-41f4-ae66-54f040ac2dfc None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.169121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c2892-e5ef-44d0-9e40-ebfa343b0af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.169671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2892-e5ef-44d0-9e40-ebfa343b0af5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.169946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2892-e5ef-44d0-9e40-ebfa343b0af5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.170213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c2892-e5ef-44d0-9e40-ebfa343b0af5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.171337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c2892-e5ef-44d0-9e40-ebfa343b0af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.172766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663c2892-e5ef-44d0-9e40-ebfa343b0af5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.174343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 508/1014] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:44.175558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.175841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.176114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.188668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:44.194394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:44.195474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885843a-d0a3-44e2-828e-951c279424d5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.195651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:44.232412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.233015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.233288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.233549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.234167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:44.234461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.235862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.240598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 507/1015] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:44.241341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.267122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 509/1016] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:44 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:44.268329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.305043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:44.353275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746c546-6c51-4b83-ba23-2824393e07b5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.375350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c00a5-7472-43fb-89e4-51709d2d289b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.387569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.388169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.388444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.388711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.389346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.391144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.411346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.411980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.412345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.412624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.413291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] RBAC: Adding query filter params (type=compute) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:44.413593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.414979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.417403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:44.420352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 508/1017] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:44 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:44.437995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 510/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 10:35:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:44.439910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.533528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:44.550706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51c81-713c-4369-b2b3-1ca5e69d087f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.563346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:44.597771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a346c-65aa-4879-9146-d7c7cf871824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.598825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a346c-65aa-4879-9146-d7c7cf871824 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.599338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a346c-65aa-4879-9146-d7c7cf871824 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.599815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a346c-65aa-4879-9146-d7c7cf871824 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.600987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a346c-65aa-4879-9146-d7c7cf871824 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.603072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a346c-65aa-4879-9146-d7c7cf871824 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.629272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 509/1019] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:44.650969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84ae8-a2fe-40fc-8e7a-4d256fdd437d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:44.696398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab4c8-a0a4-4a1c-a57e-e36d12e5b858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:44.696929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab4c8-a0a4-4a1c-a57e-e36d12e5b858 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:44.697202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab4c8-a0a4-4a1c-a57e-e36d12e5b858 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:44.697464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab4c8-a0a4-4a1c-a57e-e36d12e5b858 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:44.698116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ab4c8-a0a4-4a1c-a57e-e36d12e5b858 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:44.699519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ab4c8-a0a4-4a1c-a57e-e36d12e5b858 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:44.716521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 511/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:35:44 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:46.365187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfd42-7e7d-41ee-a977-7343a045f3df None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.365795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfd42-7e7d-41ee-a977-7343a045f3df None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.365795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bfd42-7e7d-41ee-a977-7343a045f3df None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.367266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 510/1021] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:46.372418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9168a-e452-44b5-a605-24eb3051b43f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.372873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9168a-e452-44b5-a605-24eb3051b43f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.372956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9168a-e452-44b5-a605-24eb3051b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.392079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d3a9168a-e452-44b5-a605-24eb3051b43f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:46.393273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d3a9168a-e452-44b5-a605-24eb3051b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:46.446100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:46.471911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 512/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:46.606249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9cf0-3bda-4d9c-8053-a2230b62bcfc None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.606498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9cf0-3bda-4d9c-8053-a2230b62bcfc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.606786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9cf0-3bda-4d9c-8053-a2230b62bcfc None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.608300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 511/1023] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:46.613320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.613578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.613871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.624875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07028-b792-41ea-a391-e16164fbbfd0 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.625047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07028-b792-41ea-a391-e16164fbbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.625340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07028-b792-41ea-a391-e16164fbbfd0 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.626840 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 512/1024] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:35:46.631512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.631793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.632160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.633273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:46.634510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:46.653419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:46.654917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:46.704654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 513/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:46.738736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 513/1026] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:46.738950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:46.833553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbab561-b02d-480a-b203-9a0704ae52f8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:46.847201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:46.869433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:46.870061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:46.870334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:46.870601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:46.871733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:46.873169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:46.875035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 514/1027] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:46.880568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:46.970334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:46.975494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:46.984724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e63b89-fc2e-4af3-b7f5-b11d96d1af2a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.017410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.018005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.018276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.018540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.019270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.020703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.054706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 514/1028] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:35:46 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:47.054706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.085934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeb291-1440-47a8-8be6-ea767f1b1e0c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.122307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.122991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.123273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.123546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.135568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:47.140746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:47.141969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:47.142917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 515/1029] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 10:35:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:47.148548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.159700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609f364-33d4-44f6-8047-83e8b77cb398 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.195659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.201048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.202714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.202714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.202714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] PATH_INFO: `/v3/services/image` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.202714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.204528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:47.214564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:47.215783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:47.216658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 515/1030] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:47.226612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.253700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.272009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df33a6-0102-47ac-9dab-7c8f5d9445c5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.310639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.311571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.311847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.312105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.312770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:47.313135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.314486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.323795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 516/1031] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:47.328997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.360129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e0207-23bd-4ad7-9455-66238a99de79 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.396346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.397344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.397634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.397902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.398836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] RBAC: Adding query filter params (name=image) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:47.399138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.401428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.411568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 516/1032] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:47.413063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.431977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09acda-b925-44a4-8bc8-264333e0490c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.433702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.467049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.467732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.467950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.468221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.479131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.480582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:47.495052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:47.496045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:47.496937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:47.496937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:47.496937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:47.496937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 517/1033] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:47.502206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.503841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.524671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c7977-7c34-4dfa-acbd-be7ecfe65959 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.560222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.560834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.561109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.561379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.562009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] RBAC: Adding query filter params (type=image) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:47.562301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.563699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.573126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 517/1034] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:47.574109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.615376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906598c-a482-48b6-8ee9-a3140d4a64d2 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.649896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.650446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.650701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.651005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.651643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:47.651934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.653297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.665408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 518/1035] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:47.670727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.678659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80b870-f79c-4b93-9f98-de19ec923960 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.686189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.714911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.715517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.715789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.716053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.716745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] RBAC: Adding query filter params (interface=public, service_id=da89cf5f9f424120b695fcf6f69b93f4, region_id=RegionOne) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:47.717043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.718408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.727981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 518/1036] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/endpoints?service_id=da89cf5f9f424120b695fcf6f69b93f4&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:47.729169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.740561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.783455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae703104-9c01-4c25-aafe-93e77e737744 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.824026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.824647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.824921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.825188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.831265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0458c09-3bbb-4c87-8c3a-dad4e5785584 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:47.832404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.834077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:47.845917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:47.846967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:47.847921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 519/1037] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:47.852685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:47.868929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:47.869535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:47.869811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:47.870073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:47.870696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:47.872099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:47.878602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 519/1038] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:35:47.942538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:47.974921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ccd7a-9224-4991-98d6-c2e9dd77ca52 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:48.012931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:48.013541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:48.013817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:48.014647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:48.014848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:48.015470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:48.016902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:48.037448 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 520/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:48.043181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:48.119102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:48.150535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b225daf-86e5-496e-bb14-9248582e7e13 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:48.187280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:48.187894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:48.188167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:48.188400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:48.266417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:48.267865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:48.337569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:48.371401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 520/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:48.376865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:48.479342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e105e25-8b51-4ac9-be21-72a56485caa3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:48.508851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:48.515589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:48.516232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:48.516555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:48.516756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:48.527360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:48.528846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:48.543370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:48.544323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:48.545212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:48.545212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:48.545212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:48.547042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 521/1041] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:48.550235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:48.651959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c9e38-78a3-422a-b443-34d489b7b1cb None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:48.685980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:48.686590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:48.686889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:48.687159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:48.687791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:48.688090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:48.689455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:48.705290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 521/1042] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:48.706569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:48.809026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54274d31-eee7-4afa-bfe0-e6ee39408fcb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:48.843144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:48.843773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:48.844044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:48.844310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:48.851080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:48.852559 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-a8df21b7-4404-41bf-9a78-935edb878b2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:48.863737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:48.864696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:48.865616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:48.867045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 522/1043] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:48.870734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:48.904240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:48.992307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7381e-fb2f-4705-90e6-2711ec5f03e5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:49.005396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc42b55-980e-4c8a-b442-f2a4a279a068 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.005996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc42b55-980e-4c8a-b442-f2a4a279a068 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.006345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc42b55-980e-4c8a-b442-f2a4a279a068 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.007757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 523/1044] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:49.012915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.013206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.013512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.029019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:49.029642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.029920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.030190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.030939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:49.031245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:49.032682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:49.036218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:49.037626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:49.045572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 522/1045] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:49.052257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:49.086041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:49.113338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 524/1046] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:49.149428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:49.158955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47c908-b7ac-4780-a463-db019b7410c1 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:49.193752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:49.194356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.194637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.194948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.195678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] RBAC: Adding query filter params (role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=e37ccc38bfcb43288a9f451428d293e0) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:49.195988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:49.197429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:49.203201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 523/1047] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:49 2022] GET /identity/v3/role_assignments?user.id=e37ccc38bfcb43288a9f451428d293e0&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:49.378145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:49.483731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7bb4c-dcc2-4e27-89c6-a6d65bdb4e83 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:49.519494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:49.520123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.520383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.520649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.531080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:49.535901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:49.536841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:49.539522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 525/1048] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:49.543707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:49.648603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0a8e-d499-492f-a277-f4dbcfb53991 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:49.682224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:49.682869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.683148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.683418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.684081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:49.684381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:49.685757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1cc2c-ae9d-448f-a87f-3aab15d43f16 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:49.694725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 524/1049] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:49.701032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:49.738620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:49.775383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62c0e-4996-4bf3-b64a-669f878c4cf6 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.775658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62c0e-4996-4bf3-b64a-669f878c4cf6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.775927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62c0e-4996-4bf3-b64a-669f878c4cf6 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.777267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 525/1050] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:49.782417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.782704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.782992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.801935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:49.803142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:49.815332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdb523-b557-48d3-af34-a26dc5f31400 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:49.817382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:49.852556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:49.853174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:49.853513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:49.853715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] PATH_INFO: `/v3/users/f3a183d0142247588fa32f0eaf337b68` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:49.867024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] RBAC: Authorizing `identity:get_user(user_id=f3a183d0142247588fa32f0eaf337b68)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:49.868470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:49.874750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 526/1051] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:35:49 2022] GET /identity/v3/users/f3a183d0142247588fa32f0eaf337b68 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:49.876384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:49.879679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 526/1052] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:49.971003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:49.981083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e921-2321-451a-a62a-98d2104f0f59 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.018475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.021109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.021382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.021652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.089353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.090822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.143346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:50.184107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:50.195573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 527/1053] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 10:35:50.201029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:50.265012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1263c-f484-4e9c-a8a0-32005d651dd9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.301922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.302554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.302853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.303124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] PATH_INFO: `/v3/services/image` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.303707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.305074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.307233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10915-bf61-413d-b201-637792d12b60 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:50.313509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:50.318743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:50.319657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 527/1054] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Aug 12 10:35:50 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:50.321476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:50.336964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:50.351461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.352097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.352374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.352633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.353748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] RBAC: Authorizing `identity:get_project(project_id=09dc5ae68db5429dbd13c79f21e29ace)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.355216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.356844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 528/1055] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:35:50 2022] GET /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:50.362904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:50.423088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:50.429670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf9200-043d-48da-ab15-2c95cf3a9a1a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.464671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.465273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.465555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.465824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.466457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:50.466816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.468156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.469056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a280762-39f4-43d2-b5e1-e5acd86d0e04 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.473380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 528/1056] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:50.478995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:50.508382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.509036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.509318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.509570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.510350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=09dc5ae68db5429dbd13c79f21e29ace, user.id=f3a183d0142247588fa32f0eaf337b68) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:50.510659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.512118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.527400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 529/1057] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:50 2022] GET /identity/v3/role_assignments?user.id=f3a183d0142247588fa32f0eaf337b68&scope.project.id=09dc5ae68db5429dbd13c79f21e29ace&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:50.561231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:50.588921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64485232-fa9d-45f5-bd5a-9d2113fa18c6 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.626881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.627515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.627790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.628084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.628734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] RBAC: Adding query filter params (type=image) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:50.629039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.630434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c115b5-6dde-4ba5-bf66-2c10768f1ae9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.636326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 529/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:50.642422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:50.745568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406449f-78fb-4f0e-84c5-00f0480a4444 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:50.774797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:50.788151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529357e3-cdae-441f-9613-8ec468f74f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:50.789110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529357e3-cdae-441f-9613-8ec468f74f03 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:50.789588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529357e3-cdae-441f-9613-8ec468f74f03 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:50.790081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529357e3-cdae-441f-9613-8ec468f74f03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:50.791041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529357e3-cdae-441f-9613-8ec468f74f03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:50.792616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529357e3-cdae-441f-9613-8ec468f74f03 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:50.817516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 530/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:35:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:35:51.077735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81784bf4-0a1c-47ab-b1af-f0409587ca67 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:51.078247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81784bf4-0a1c-47ab-b1af-f0409587ca67 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:51.078247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81784bf4-0a1c-47ab-b1af-f0409587ca67 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:51.079674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 530/1060] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:51.085365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:51.085719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:51.086184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:51.109455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:51.111060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:51.186666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 531/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:51.453555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81784bf4-0a1c-47ab-b1af-f0409587ca67 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:51.554818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81784bf4-0a1c-47ab-b1af-f0409587ca67 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:51.591204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:51.591904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:51.592147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:51.592427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:51.602141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:51.609512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:51.615213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:51.616160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:51.619618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 531/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 10:35:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:51.622545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:51.728687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6715dcf-c546-4234-82f2-2a0bb5634d9e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:51.735914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:51.765045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:51.765958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:51.766233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:51.766498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:51.767193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:51.767492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:51.768894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:51.777032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 532/1063] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:35:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:51.782555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:51.884076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117ed3a-c329-43ee-881b-a1b4404c604c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:51.918085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:51.918731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:51.919018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:51.919282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:51.932207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:51.933687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:51.950045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:51.951446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:51.952652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:51.952652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:51.952652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:51.955034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 532/1064] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:51.957062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.067832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e87c2-e190-4b75-8d3b-3101dcf0650a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.101198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.101828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.102104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.102372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.103043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:52.103342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:52.104706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:52.116881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 533/1065] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:52.122377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.175036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:52.222618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcd12f-1d68-4b50-b665-1bfff041ca71 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.258709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.260245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.260245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.260447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] PATH_INFO: `/v3/users/nova` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.272260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:52.274365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-241379d6-c1c0-488b-a232-ab39c6fc3aad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:52.287982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:52.289000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:52.289949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:52.295053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 533/1066] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:52.296766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.327878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:52.408528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950f9d4-82a0-42e9-a679-be53da782cb2 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.431363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679ab5-f3b1-4ac1-86a9-bc234440b9c3 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.431742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679ab5-f3b1-4ac1-86a9-bc234440b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.432089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12679ab5-f3b1-4ac1-86a9-bc234440b9c3 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.433463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 534/1067] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:52.439255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.439561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.439791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.446040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.446652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.446971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.447243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.447981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:52.448284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:52.449701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:52.461663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:52.462901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:52.471494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 534/1068] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:52.472677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.550958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 535/1069] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:52.560314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:52.576469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca75884-04cc-4e40-98ad-269ce06f4051 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.618437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.619095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.619370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.619635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.630377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:52.631866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:52.646923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:52.647869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:52.648778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:52.648778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:52.648778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:52.651023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 535/1070] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:52.653816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.698575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:52.756211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56afae3-d588-4565-a86e-5f5bee19cb19 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.790862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.791397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.791666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.791933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.792570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:52.792864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:52.794233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:52.801774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.806154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 536/1071] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:52.811643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.902210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb1f51-44bd-4719-a7d0-637bb62c789c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.911071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20b49e-0428-4849-a951-3e5669bfdd48 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:52.912556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:52.935120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf278f-d82a-4f97-aac3-c0e801a8e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.935820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf278f-d82a-4f97-aac3-c0e801a8e6a2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.936095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf278f-d82a-4f97-aac3-c0e801a8e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.936360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf278f-d82a-4f97-aac3-c0e801a8e6a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.943002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:52.947255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:52.947466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf278f-d82a-4f97-aac3-c0e801a8e6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:52.947903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.948190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.948441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b7bf278f-d82a-4f97-aac3-c0e801a8e6a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:52.952247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:52.953355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:52.954213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 536/1072] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:52.954981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41f08e-5365-4232-a0b9-a96470bc0839 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.955358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41f08e-5365-4232-a0b9-a96470bc0839 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.955459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41f08e-5365-4232-a0b9-a96470bc0839 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.956444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:52.956672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 537/1073] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:52.957883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:52.959358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41f08e-5365-4232-a0b9-a96470bc0839 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-27806e3f-91f1-495c-9ce0-2329e1f2bf5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:52.975796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:52.976857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:52.977767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 537/1074] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:52.978471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:52.978732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:52.979023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:52.996793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:52.997985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:53.064631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 538/1075] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:53.065376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.069040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41f08e-5365-4232-a0b9-a96470bc0839 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.107197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.108078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.108241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.108568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.109300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:53.109674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.111128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.119476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 538/1076] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:53.125007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.165545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:53.178231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0150d4e8-119c-48f5-8394-669d4c25915e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.187622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:53.216665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.217277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.217552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.217821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.218509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:53.218847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.220273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.230390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be257c07-568b-4a83-a98a-26402144c928 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.232612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 539/1077] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:53.238434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.270916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173789d2-349e-4552-af84-16651026f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.271758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173789d2-349e-4552-af84-16651026f14c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.272171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173789d2-349e-4552-af84-16651026f14c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.272601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173789d2-349e-4552-af84-16651026f14c None admin] PATH_INFO: `/v3/users/f3a183d0142247588fa32f0eaf337b68` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.273941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173789d2-349e-4552-af84-16651026f14c None admin] RBAC: Authorizing `identity:get_user(user_id=f3a183d0142247588fa32f0eaf337b68)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.275618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173789d2-349e-4552-af84-16651026f14c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.277635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 539/1078] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:35:53 2022] GET /identity/v3/users/f3a183d0142247588fa32f0eaf337b68 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:53.283121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173789d2-349e-4552-af84-16651026f14c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.342926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b16ea-0d21-46ed-a6eb-d4d77a836991 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.375415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.376076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.376353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.376622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/e37ccc38bfcb43288a9f451428d293e0/roles/2888c1e8c9ff4cb8a455a91c0b0f60bb` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.379109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=e37ccc38bfcb43288a9f451428d293e0, role_id=2888c1e8c9ff4cb8a455a91c0b0f60bb)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.380584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.388036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173789d2-349e-4552-af84-16651026f14c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.394394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 540/1079] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:53 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/e37ccc38bfcb43288a9f451428d293e0/roles/2888c1e8c9ff4cb8a455a91c0b0f60bb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:35:53.399277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.419326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:53.425854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:53.436040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.436859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.437210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.437548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.438928 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] RBAC: Authorizing `identity:get_project(project_id=09dc5ae68db5429dbd13c79f21e29ace)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.440556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.447534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 540/1080] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:35:53 2022] GET /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:53.448812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.516502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0901b-ccd7-4ef2-96d1-2d0988999256 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.555203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.555823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.556101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.556360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.564789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f7d8b-1659-4109-9a85-fc134d9c853a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.601367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.601936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.602209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.602478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace/users/f3a183d0142247588fa32f0eaf337b68/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.604392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=09dc5ae68db5429dbd13c79f21e29ace, user_id=f3a183d0142247588fa32f0eaf337b68, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.605817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.619663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 541/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:35:53 2022] PUT /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace/users/f3a183d0142247588fa32f0eaf337b68/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:35:53.631639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.633136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.649524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:53.745763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 541/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:53.751847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:53.814456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:53.864231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944f245-e727-4c6f-9560-877b390a72d5 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:53.899042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:53.899674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:53.899950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:53.900217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:53.911367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:53.912819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-5c184bb2-3bc4-4039-a408-33c5b8e94a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:53.926884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:53.927826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:53.928758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:53.928758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:53.928758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:53.928758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 542/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:53.934276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:54.038189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174b832-5690-42af-b3ec-e6c1bab2e892 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:54.051295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:54.073164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:54.073768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:54.074045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:54.074309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:54.074977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:54.075273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:54.076631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdee6f-eecc-4eb1-bc8e-5580d070efda None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:54.090533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 542/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:55.253608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368932d-f49a-4c4e-9cf0-d720c11d2244 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.254134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368932d-f49a-4c4e-9cf0-d720c11d2244 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.254134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368932d-f49a-4c4e-9cf0-d720c11d2244 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:55.255409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 543/1085] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:55.260788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb7ade-31ee-4e8c-b533-b75e9f8270f9 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.261198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb7ade-31ee-4e8c-b533-b75e9f8270f9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.261325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb7ade-31ee-4e8c-b533-b75e9f8270f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:55.281066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8beb7ade-31ee-4e8c-b533-b75e9f8270f9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:55.282277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8beb7ade-31ee-4e8c-b533-b75e9f8270f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:55.349606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 543/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:35:55.500849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0f3ab-5674-41de-be3b-115cea686f06 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.501120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0f3ab-5674-41de-be3b-115cea686f06 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.501391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0f3ab-5674-41de-be3b-115cea686f06 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:55.502761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 544/1087] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:55.508205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.508425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.508691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:55.527180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:55.528333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:55.594852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 544/1088] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:55.613246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0f3ab-5674-41de-be3b-115cea686f06 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:55.716136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0f3ab-5674-41de-be3b-115cea686f06 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:55.725374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:55.751507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:55.752120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.752396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.752649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:55.763195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:55.768124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:55.769227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:55.770061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 545/1089] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 10:35:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:55.775566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:55.808122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:55.856525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:55.878900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077fd44-9ff6-4ec2-bae5-1f7b75c8e946 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:55.912105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:55.912693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.912959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.913228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:55.913876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:55.914172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:55.915578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:55.923159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 545/1090] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:35:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:55.928909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:55.958192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6c4db-9365-41a8-acde-154bbbb62086 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:55.993173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:55.993806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:55.994088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:55.994358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.004704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:35:56.009361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:56.010438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:35:56.011327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 546/1091] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:56.016670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.021988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.029301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b12c8a-0215-4896-a8cb-fca227c8ee9b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.043966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.061395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.062018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.062311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.062555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.072678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.074159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:56.087820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:56.093944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:56.095159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:56.095159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:56.095159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:56.095159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 546/1092] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:56.095159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.115360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dcd27-5992-488a-9221-dba3f940844d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.148724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.149319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.149593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.149864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.150522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:56.150857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.152216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.160028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 547/1093] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:56.165758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.190609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a8378d-82c7-4bca-a848-d8146fa27c48 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.222791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.223394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.223669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.223936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.224578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:56.224878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.226255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.237583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 547/1094] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:56.243136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.251071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.254849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.265423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0eee1-9441-423a-a7ca-3dec0cb3cc8b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.298855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.299476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.299762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.300020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] PATH_INFO: `/v3/users/f3a183d0142247588fa32f0eaf337b68` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.301770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] RBAC: Authorizing `identity:get_user(user_id=f3a183d0142247588fa32f0eaf337b68)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.303915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.312346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 548/1095] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/users/f3a183d0142247588fa32f0eaf337b68 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:56.313479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.344684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd7db2-80bd-43fe-a8df-cb308d9acfd4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.377756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.378407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.378710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.378985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.386187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.387661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:35:56.399668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:56.400800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:56.401772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 548/1096] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:56.406404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.416920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0817-c9de-412b-b021-4915af5f9858 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.450029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.450628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.450939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.451217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.467771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.479100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.503526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5375651-3c37-4e2f-bf62-f13d1be36679 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.519632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.521077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.539373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.539974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.540249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.540521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.541273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:56.541558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.543001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.560126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 549/1097] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:56.565969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.619976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 549/1098] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:56.625958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.664906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da4df-257d-4485-946d-81fb6492a8e6 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.682977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.688857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.699738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.700340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.700623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.700890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.725134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad61c0-4c86-464f-beae-6657f7bfdb64 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.758016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.758637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.758949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.759219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.760330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] RBAC: Authorizing `identity:get_project(project_id=09dc5ae68db5429dbd13c79f21e29ace)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.761788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.763455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 550/1099] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:56.767184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.768768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.770219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.864637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 550/1100] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:35:56.865550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1c82-0522-41c9-b080-869cf33745ff None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:56.870357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:56.893122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.893661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:56.902631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:56.903253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:56.903534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:56.903803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:56.904547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=09dc5ae68db5429dbd13c79f21e29ace, user.id=f3a183d0142247588fa32f0eaf337b68) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:56.904838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:56.906273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:56.911980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 551/1101] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/role_assignments?user.id=f3a183d0142247588fa32f0eaf337b68&scope.project.id=09dc5ae68db5429dbd13c79f21e29ace&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:56.977607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b9a64-c903-4047-b028-4ea01de409fd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:57.017880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:57.018528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:57.018871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:57.019104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:57.030394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:57.031899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:35:57.048100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:57.049335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:35:57.051469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:35:57.051469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:35:57.051469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:57.051469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 551/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:35:57.055866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:57.160639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00170ed4-488c-48b4-884a-632ff556c81e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:57.193494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:57.194103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:57.194382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:57.194653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:57.195330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:57.195634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:57.197014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:57.208664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 552/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:57.214395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:57.296254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:57.321000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf421-d98c-4cc7-a0e8-8c9b40137199 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:57.357374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:57.358054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:57.358257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:57.358526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:57.365535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:57.367014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:35:57.378082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:35:57.379070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:35:57.379981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 552/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:35:57.385355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:57.438065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:57.488645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a13c7-b8dc-470f-a110-fffc04662528 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:57.523273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:57.523871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:57.524145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:57.524436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:57.525100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:57.525401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:57.526855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103fbbe-4b7d-4879-9abd-ba7a63f15987 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:57.538557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 553/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:35:57.544854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:57.647578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc939b-b006-4dc0-9422-190ce8a34541 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:57.682502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:57.683136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:57.683438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:57.683707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:57.684427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] RBAC: Adding query filter params (role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=e37ccc38bfcb43288a9f451428d293e0) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:35:57.684732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:57.686198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a7966-f032-4141-ba80-31149333d298 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:57.689270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:57.692971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 553/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:35:57 2022] GET /identity/v3/role_assignments?user.id=e37ccc38bfcb43288a9f451428d293e0&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=2888c1e8c9ff4cb8a455a91c0b0f60bb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:58.804149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b022-2639-466c-9004-c51ba5d317d2 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:58.805094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b022-2639-466c-9004-c51ba5d317d2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:58.805094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b022-2639-466c-9004-c51ba5d317d2 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:58.807174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 554/1107] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:35:58.815060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:58.815494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:58.815584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:58.835187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:35:58.836353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:35:58.904606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 554/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:35:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:35:59.179207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b022-2639-466c-9004-c51ba5d317d2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:59.298235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b022-2639-466c-9004-c51ba5d317d2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:59.308786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:59.336229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf12d3-9bc2-4205-982a-4baa4bb2639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:59.336838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf12d3-9bc2-4205-982a-4baa4bb2639a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:59.337116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf12d3-9bc2-4205-982a-4baa4bb2639a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:59.337385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf12d3-9bc2-4205-982a-4baa4bb2639a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:59.338644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf12d3-9bc2-4205-982a-4baa4bb2639a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:59.340110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf12d3-9bc2-4205-982a-4baa4bb2639a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:59.341668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 555/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:35:59.347761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:35:59.452964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd56d3-6f4a-417f-8163-c39690a615b7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:35:59.481379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:35:59.489347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b87e7-24b3-462b-818e-59bbd082914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:35:59.490270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b87e7-24b3-462b-818e-59bbd082914d None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:35:59.490632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b87e7-24b3-462b-818e-59bbd082914d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:35:59.491042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b87e7-24b3-462b-818e-59bbd082914d None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:35:59.491997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b87e7-24b3-462b-818e-59bbd082914d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:35:59.494183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b87e7-24b3-462b-818e-59bbd082914d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:35:59.523902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 555/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:35:59 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:36:01.416040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0b498-6589-4e23-86db-15405ff7b221 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:01.416707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0b498-6589-4e23-86db-15405ff7b221 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:01.416707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0b498-6589-4e23-86db-15405ff7b221 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:01.417894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 556/1111] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:01.424143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:01.424597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:01.424723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:01.449721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:01.450935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:01.522837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 556/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:01.796899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0b498-6589-4e23-86db-15405ff7b221 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:01.907284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0b498-6589-4e23-86db-15405ff7b221 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:01.944142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:01.944758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:01.945033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:01.945298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] PATH_INFO: `/v3/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:01.946735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] RBAC: Authorizing `identity:get_role(role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:01.948118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:01.949422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 557/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:01 2022] GET /identity/v3/roles/847d13d004f94d888ecf8be41cb07086 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:01.955928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:02.059628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7135a-ec56-463b-b1ee-eadb26097ac7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:02.077033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:02.097202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:02.097845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:02.098131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:02.098387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] PATH_INFO: `/v3/users/cc4f33a70cc94450b32b7a5982249a31` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:02.111258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] RBAC: Authorizing `identity:get_user(user_id=cc4f33a70cc94450b32b7a5982249a31)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:02.112725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:02.114318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 557/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:01 2022] GET /identity/v3/users/cc4f33a70cc94450b32b7a5982249a31 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:02.120360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:02.170697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:02.227707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b460c59-2ccd-47dd-b6ef-20d5eb84d99c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:02.263328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:02.263912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:02.264181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:02.264447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:02.334402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:02.335815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:02.394724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:02.451609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 558/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:02.459201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:02.561642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5b270-9eae-44ac-bf26-78355776ae9d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:02.596404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e16dcd-45a4-4e5f-bea1-fa2a95eba245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:02.596985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16dcd-45a4-4e5f-bea1-fa2a95eba245 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:02.597259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16dcd-45a4-4e5f-bea1-fa2a95eba245 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:02.597531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e16dcd-45a4-4e5f-bea1-fa2a95eba245 None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:02.598630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e16dcd-45a4-4e5f-bea1-fa2a95eba245 None admin] RBAC: Authorizing `identity:get_project(project_id=09dc5ae68db5429dbd13c79f21e29ace)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:02.600102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e16dcd-45a4-4e5f-bea1-fa2a95eba245 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:02.601699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 558/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:02 2022] GET /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:02.611612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:02.724971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5be8-8cad-4ef5-ae93-66232c70d811 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:02.768007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:02.768704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:02.768987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:02.769256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:02.769989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] RBAC: Adding query filter params (role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=09dc5ae68db5429dbd13c79f21e29ace, user.id=cc4f33a70cc94450b32b7a5982249a31) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:02.770299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:02.771784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7ace2-960d-4bf4-af30-c5f68a283d84 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:02.777389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 559/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:36:02 2022] GET /identity/v3/role_assignments?user.id=cc4f33a70cc94450b32b7a5982249a31&scope.project.id=09dc5ae68db5429dbd13c79f21e29ace&role.id=847d13d004f94d888ecf8be41cb07086 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:04.644205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a90aa-ece3-4a1b-bf44-7cfbafc4773f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:04.644801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a90aa-ece3-4a1b-bf44-7cfbafc4773f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:04.644801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a90aa-ece3-4a1b-bf44-7cfbafc4773f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:04.646082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 559/1118] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:04.652480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:04.653192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:04.653363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:04.675072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:04.676282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:04.679190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:04.751633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 560/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:05.011608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a90aa-ece3-4a1b-bf44-7cfbafc4773f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:05.063645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:05.128235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a90aa-ece3-4a1b-bf44-7cfbafc4773f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:05.163182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:05.163800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:05.164071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:05.164340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] PATH_INFO: `/v3/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:05.165771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] RBAC: Authorizing `identity:get_role(role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:05.167214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:05.168545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 560/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:05 2022] GET /identity/v3/roles/847d13d004f94d888ecf8be41cb07086 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:05.175645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:05.286055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136c93-1eee-4c88-82e8-14fcad85185d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:05.320947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:05.321594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:05.321867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:05.322130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] PATH_INFO: `/v3/users/cc4f33a70cc94450b32b7a5982249a31` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:05.323484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] RBAC: Authorizing `identity:get_user(user_id=cc4f33a70cc94450b32b7a5982249a31)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:05.324875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:05.326434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 561/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:05 2022] GET /identity/v3/users/cc4f33a70cc94450b32b7a5982249a31 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:05.333428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:05.455345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4864a-e2e9-45db-922a-6676f505118c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:05.467229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:05.495393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b5606-d918-4a28-811d-8181b15c9f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:05.496015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b5606-d918-4a28-811d-8181b15c9f55 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:05.496294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b5606-d918-4a28-811d-8181b15c9f55 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:05.496562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b5606-d918-4a28-811d-8181b15c9f55 None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:05.497820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b5606-d918-4a28-811d-8181b15c9f55 None admin] RBAC: Authorizing `identity:get_project(project_id=09dc5ae68db5429dbd13c79f21e29ace)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:05.499348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b5606-d918-4a28-811d-8181b15c9f55 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:05.501034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 561/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:05 2022] GET /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:05.507727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:05.520586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:05.610260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f667-238f-43a6-b12c-d379abfbe121 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:05.645352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f5bd1-b5a6-49bb-9a3d-c4278f802389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:05.645988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f5bd1-b5a6-49bb-9a3d-c4278f802389 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:05.646257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f5bd1-b5a6-49bb-9a3d-c4278f802389 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:05.646530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f5bd1-b5a6-49bb-9a3d-c4278f802389 None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace/users/cc4f33a70cc94450b32b7a5982249a31/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:05.649044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f5bd1-b5a6-49bb-9a3d-c4278f802389 None admin] RBAC: Authorizing `identity:create_grant(project_id=09dc5ae68db5429dbd13c79f21e29ace, user_id=cc4f33a70cc94450b32b7a5982249a31, role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:05.650472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f5bd1-b5a6-49bb-9a3d-c4278f802389 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:05.666485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 562/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:36:05 2022] PUT /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace/users/cc4f33a70cc94450b32b7a5982249a31/roles/847d13d004f94d888ecf8be41cb07086 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:36:07.533374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e587c-865c-45de-8c6f-1fc3d4e5ba00 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:07.534339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e587c-865c-45de-8c6f-1fc3d4e5ba00 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:07.534339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e587c-865c-45de-8c6f-1fc3d4e5ba00 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:07.536480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 562/1124] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:07.545083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:07.545515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:07.545857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:07.571532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:07.572733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:07.638943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:07.645171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 563/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:07.918515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e587c-865c-45de-8c6f-1fc3d4e5ba00 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:08.028030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e587c-865c-45de-8c6f-1fc3d4e5ba00 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:08.068522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:08.069142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:08.069414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:08.069682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] PATH_INFO: `/v3/roles/847d13d004f94d888ecf8be41cb07086` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:08.071214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] RBAC: Authorizing `identity:get_role(role_id=847d13d004f94d888ecf8be41cb07086)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:08.072593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:08.073908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 563/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:07 2022] GET /identity/v3/roles/847d13d004f94d888ecf8be41cb07086 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:08.083361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:08.191995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd79bf-6886-416a-a5f1-cc001c2a9447 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:08.227181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:08.227791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:08.228066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:08.228334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] PATH_INFO: `/v3/users/cc4f33a70cc94450b32b7a5982249a31` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:08.229571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] RBAC: Authorizing `identity:get_user(user_id=cc4f33a70cc94450b32b7a5982249a31)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:08.231026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:08.232583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 564/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:08 2022] GET /identity/v3/users/cc4f33a70cc94450b32b7a5982249a31 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:08.239473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:08.293707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:08.347832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381a4c1-f0ed-45df-a183-760f8da289f3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:08.386836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:08.387347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:08.387623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:08.387886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:08.464559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:08.465928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:08.510692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:08.571777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 564/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:08.580408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:08.650628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:08.690727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a84324-1344-4536-99fc-8f668b40718c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:08.726563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ea7b3-c860-4ec4-a985-b2a84187ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:08.727144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ea7b3-c860-4ec4-a985-b2a84187ed0b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:08.727382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ea7b3-c860-4ec4-a985-b2a84187ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:08.727673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ea7b3-c860-4ec4-a985-b2a84187ed0b None admin] PATH_INFO: `/v3/projects/09dc5ae68db5429dbd13c79f21e29ace` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:08.728909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ea7b3-c860-4ec4-a985-b2a84187ed0b None admin] RBAC: Authorizing `identity:get_project(project_id=09dc5ae68db5429dbd13c79f21e29ace)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:08.730335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ea7b3-c860-4ec4-a985-b2a84187ed0b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:08.731987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 565/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:08 2022] GET /identity/v3/projects/09dc5ae68db5429dbd13c79f21e29ace => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:08.738404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:08.838708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509117f6-b3fd-4739-9a62-38cd0a33fe7a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:08.873878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:08.874486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:08.874938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:08.875068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:08.875762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] RBAC: Adding query filter params (role.id=847d13d004f94d888ecf8be41cb07086, scope.project.id=09dc5ae68db5429dbd13c79f21e29ace, user.id=cc4f33a70cc94450b32b7a5982249a31) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:08.876063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:08.877483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ad3a17-bd2a-4105-8af3-2d4facac26a9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:08.885657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 565/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:36:08 2022] GET /identity/v3/role_assignments?user.id=cc4f33a70cc94450b32b7a5982249a31&scope.project.id=09dc5ae68db5429dbd13c79f21e29ace&role.id=847d13d004f94d888ecf8be41cb07086 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:10.796217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7af9-408c-4a2b-b9ac-b7a1248a4b87 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:10.797103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7af9-408c-4a2b-b9ac-b7a1248a4b87 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:10.797103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c7af9-408c-4a2b-b9ac-b7a1248a4b87 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:10.799385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 566/1131] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:10.805797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:10.806520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:10.806614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:10.833915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:10.835143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:10.837901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:10.904432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 566/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:11.164076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7af9-408c-4a2b-b9ac-b7a1248a4b87 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:11.279268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c7af9-408c-4a2b-b9ac-b7a1248a4b87 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:11.314281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89e165-118d-455f-b04e-904c2c4717d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:11.314917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89e165-118d-455f-b04e-904c2c4717d8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:11.315194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89e165-118d-455f-b04e-904c2c4717d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:11.315513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89e165-118d-455f-b04e-904c2c4717d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:11.316744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89e165-118d-455f-b04e-904c2c4717d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:11.318165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89e165-118d-455f-b04e-904c2c4717d8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:11.319742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 567/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:36:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:11.326465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:11.447823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba77a5-fd0d-4391-9972-d111ffc4b40f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:11.482816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932c18a-ad11-429e-8105-c18aedba871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:11.483392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932c18a-ad11-429e-8105-c18aedba871a None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:11.483690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932c18a-ad11-429e-8105-c18aedba871a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:11.483954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932c18a-ad11-429e-8105-c18aedba871a None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:11.484590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932c18a-ad11-429e-8105-c18aedba871a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:11.486021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932c18a-ad11-429e-8105-c18aedba871a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:11.497001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:11.520517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 567/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:36:11 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:36:13.401446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961de8-296d-4805-84d7-d516495fec2f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:13.402298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961de8-296d-4805-84d7-d516495fec2f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:13.402298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0961de8-296d-4805-84d7-d516495fec2f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:13.404570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 568/1135] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:13.411134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:13.411550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:13.411693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:13.441873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:13.443096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:13.513026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 568/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:13.790075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961de8-296d-4805-84d7-d516495fec2f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:13.793509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:13.900508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0961de8-296d-4805-84d7-d516495fec2f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:13.935520 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8af58-c175-42c3-86f4-d25497b4bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:13.936132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8af58-c175-42c3-86f4-d25497b4bf37 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:13.936410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8af58-c175-42c3-86f4-d25497b4bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:13.936676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8af58-c175-42c3-86f4-d25497b4bf37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:13.937798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8af58-c175-42c3-86f4-d25497b4bf37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:13.939264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8af58-c175-42c3-86f4-d25497b4bf37 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:13.940831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 569/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:36:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:13.950037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:14.052473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a01f4-a9e6-40ea-9690-f5b92402de08 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:14.074669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:14.087725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0643b-c570-4331-b94e-0b1d423d5bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:14.088323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0643b-c570-4331-b94e-0b1d423d5bf0 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:14.088597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0643b-c570-4331-b94e-0b1d423d5bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:14.088865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0643b-c570-4331-b94e-0b1d423d5bf0 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:14.089502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0643b-c570-4331-b94e-0b1d423d5bf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:14.090969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0643b-c570-4331-b94e-0b1d423d5bf0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:14.113506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 569/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:36:13 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:36:16.031370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37b78-0e19-4f5c-bb12-13151eaf5299 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:16.032198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37b78-0e19-4f5c-bb12-13151eaf5299 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:16.032198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e37b78-0e19-4f5c-bb12-13151eaf5299 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:16.034431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 570/1139] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:16.040580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:16.041004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:16.041144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:16.063769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:16.064956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:16.146343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 570/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:16.421639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e37b78-0e19-4f5c-bb12-13151eaf5299 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:16.512125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:16.554967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e37b78-0e19-4f5c-bb12-13151eaf5299 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:16.591784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:16.592595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:16.593005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:16.593296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:16.605401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:36:16.610022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:16.611212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:36:16.612226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 571/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:16.617625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:16.726436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbac94-92fb-43a9-8b77-2839fc8f3cde None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:16.735412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:16.767925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:16.768584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:16.768854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:16.769117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:16.769769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:16.770064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:16.771457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:16.779754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 571/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:36:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:16.785523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:16.893106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45366-0ae8-423f-b3af-ddd610d0b744 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:16.923555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:16.929927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:16.930547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:16.930858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:16.931136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] PATH_INFO: `/v3/users/094ab7949c7b4330818303b368761109` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:16.945850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] RBAC: Authorizing `identity:get_user(user_id=094ab7949c7b4330818303b368761109)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:16.947354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:16.948940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 572/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:16 2022] GET /identity/v3/users/094ab7949c7b4330818303b368761109 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:16.958197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:17.064493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1eabd-d95e-481b-a63f-1e047080ae72 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:17.098831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:17.099429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:17.099701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:17.099969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:17.138953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:17.168584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:17.170032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:17.297952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 572/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:17.304484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:17.415371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8964a-26e6-4851-9c6f-7fcdce3f22b4 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:17.461726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d40d3b-2870-4708-bfde-85a31cc822cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:17.462347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d40d3b-2870-4708-bfde-85a31cc822cb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:17.462626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d40d3b-2870-4708-bfde-85a31cc822cb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:17.462922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d40d3b-2870-4708-bfde-85a31cc822cb None admin] PATH_INFO: `/v3/projects/72364ff0ce4f44a5b1a49d97b275a838` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:17.464081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d40d3b-2870-4708-bfde-85a31cc822cb None admin] RBAC: Authorizing `identity:get_project(project_id=72364ff0ce4f44a5b1a49d97b275a838)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:17.465528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d40d3b-2870-4708-bfde-85a31cc822cb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:17.467193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 573/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:17 2022] GET /identity/v3/projects/72364ff0ce4f44a5b1a49d97b275a838 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:17.477390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:17.554955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:17.590864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb9949-b6e4-4c91-8866-665331318c04 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:17.625603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:17.626188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:17.626459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:17.626747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:17.627459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=72364ff0ce4f44a5b1a49d97b275a838, user.id=094ab7949c7b4330818303b368761109) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:17.627783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:17.629203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3cb67-18a1-40db-886f-f7ac5904d83f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:17.634607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 573/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:36:17 2022] GET /identity/v3/role_assignments?user.id=094ab7949c7b4330818303b368761109&scope.project.id=72364ff0ce4f44a5b1a49d97b275a838&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:19.465272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95d1e-6c0a-46b8-ab81-96244f4af806 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:19.465828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95d1e-6c0a-46b8-ab81-96244f4af806 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:19.465828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95d1e-6c0a-46b8-ab81-96244f4af806 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:19.467201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 574/1147] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:19.474503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:19.475289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:19.475664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:19.505046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:19.506223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:19.574326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 574/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:19.844151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95d1e-6c0a-46b8-ab81-96244f4af806 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:19.905311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:19.951032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95d1e-6c0a-46b8-ab81-96244f4af806 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:19.995115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:19.995738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:19.996011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:19.996275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:20.006987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:36:20.011555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:20.012548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:36:20.013398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 575/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:36:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:20.019234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:20.080594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:20.120089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae74a2-3e21-4349-ae33-6dd4de97a6bb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:20.156329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:20.156919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:20.157188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:20.157453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:20.158106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:20.158405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:20.159857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:20.167994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 575/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:36:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:20.173782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:20.290649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95c4ed-5283-4a0e-9fdf-8c4acace7a1c None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:20.306949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:20.325921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198844-0854-4773-a244-567da81b1f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:20.326525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198844-0854-4773-a244-567da81b1f01 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:20.326835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198844-0854-4773-a244-567da81b1f01 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:20.327101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24198844-0854-4773-a244-567da81b1f01 None admin] PATH_INFO: `/v3/users/094ab7949c7b4330818303b368761109` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:20.328214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24198844-0854-4773-a244-567da81b1f01 None admin] RBAC: Authorizing `identity:get_user(user_id=094ab7949c7b4330818303b368761109)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:20.329633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24198844-0854-4773-a244-567da81b1f01 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:20.331246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 576/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:20 2022] GET /identity/v3/users/094ab7949c7b4330818303b368761109 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:20.337396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:20.443304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90a06b-bead-4042-8275-d01545184e9a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:20.468702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:20.479554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09ca95-cf54-4847-aed3-a7efc09282e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:20.480344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ca95-cf54-4847-aed3-a7efc09282e9 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:20.480627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ca95-cf54-4847-aed3-a7efc09282e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:20.482428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09ca95-cf54-4847-aed3-a7efc09282e9 None admin] PATH_INFO: `/v3/projects/72364ff0ce4f44a5b1a49d97b275a838` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:20.484176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09ca95-cf54-4847-aed3-a7efc09282e9 None admin] RBAC: Authorizing `identity:get_project(project_id=72364ff0ce4f44a5b1a49d97b275a838)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:20.486758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09ca95-cf54-4847-aed3-a7efc09282e9 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:20.490547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 576/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:20 2022] GET /identity/v3/projects/72364ff0ce4f44a5b1a49d97b275a838 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:20.500545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198844-0854-4773-a244-567da81b1f01 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:20.617904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24198844-0854-4773-a244-567da81b1f01 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:20.652545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde82059-d964-4406-b852-3810c759deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:20.653188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde82059-d964-4406-b852-3810c759deb3 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:20.653465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde82059-d964-4406-b852-3810c759deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:20.653736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde82059-d964-4406-b852-3810c759deb3 None admin] PATH_INFO: `/v3/projects/72364ff0ce4f44a5b1a49d97b275a838/users/094ab7949c7b4330818303b368761109/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:20.655763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde82059-d964-4406-b852-3810c759deb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=72364ff0ce4f44a5b1a49d97b275a838, user_id=094ab7949c7b4330818303b368761109, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:20.657193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde82059-d964-4406-b852-3810c759deb3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:20.676112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 577/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:36:20 2022] PUT /identity/v3/projects/72364ff0ce4f44a5b1a49d97b275a838/users/094ab7949c7b4330818303b368761109/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:36:22.541570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca18b00-f377-4066-8d02-2c17aa2aff60 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:22.542129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca18b00-f377-4066-8d02-2c17aa2aff60 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:22.542129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca18b00-f377-4066-8d02-2c17aa2aff60 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:22.543478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 577/1154] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:22.549805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:22.550512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:22.550730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:22.575504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:22.576703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:22.631211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:22.660542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 578/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:22.925010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca18b00-f377-4066-8d02-2c17aa2aff60 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:23.056978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca18b00-f377-4066-8d02-2c17aa2aff60 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:23.091520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:23.092143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:23.092423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:23.092691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:23.103786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:36:23.108488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:23.110776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:36:23.111839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 578/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:23.117156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:23.223692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513d9d9-63a4-4ee2-a6a2-a96a400cbd4f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:23.261936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:23.262534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:23.262844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:23.263109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:23.263780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:23.264088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:23.265733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:23.274536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 579/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:36:23.283837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:23.342718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:23.402549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f3b44-550f-4d33-9c5b-6b1315f157c4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:23.439692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:23.440371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:23.440647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:23.440916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] PATH_INFO: `/v3/users/094ab7949c7b4330818303b368761109` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:23.442097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] RBAC: Authorizing `identity:get_user(user_id=094ab7949c7b4330818303b368761109)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:23.443559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:23.445104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 579/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:23 2022] GET /identity/v3/users/094ab7949c7b4330818303b368761109 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:23.451774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:23.489994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:23.565412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f849a9-035c-4f69-94e6-710e299a030e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:23.600768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:23.601379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:23.601658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:23.601888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:23.671379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:23.672817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:23.706743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:23.784749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 580/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:23.794193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:23.906555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b801f5-d351-4129-8ae2-eaada436844f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:23.928859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:23.942902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665012b7-f93e-4645-bc12-dfa6bf75da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:23.943517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665012b7-f93e-4645-bc12-dfa6bf75da93 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:23.943788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665012b7-f93e-4645-bc12-dfa6bf75da93 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:23.944054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665012b7-f93e-4645-bc12-dfa6bf75da93 None admin] PATH_INFO: `/v3/projects/72364ff0ce4f44a5b1a49d97b275a838` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:23.945280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665012b7-f93e-4645-bc12-dfa6bf75da93 None admin] RBAC: Authorizing `identity:get_project(project_id=72364ff0ce4f44a5b1a49d97b275a838)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:23.946712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665012b7-f93e-4645-bc12-dfa6bf75da93 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:23.948350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 580/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:23 2022] GET /identity/v3/projects/72364ff0ce4f44a5b1a49d97b275a838 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:23.954545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:24.057736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ed80f-1063-4457-bdb1-9dd874d454f3 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:24.092562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:24.093147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:24.093422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:24.093703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:24.094446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=72364ff0ce4f44a5b1a49d97b275a838, user.id=094ab7949c7b4330818303b368761109) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:24.094844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:24.096304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0f53b-6e16-4644-99e0-f52e47a2579a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:24.099276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:24.102544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 581/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:36:23 2022] GET /identity/v3/role_assignments?user.id=094ab7949c7b4330818303b368761109&scope.project.id=72364ff0ce4f44a5b1a49d97b275a838&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:36:25.982063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af1ef5-ca51-4919-870e-f481fcefac3e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:25.982928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af1ef5-ca51-4919-870e-f481fcefac3e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:25.982928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af1ef5-ca51-4919-870e-f481fcefac3e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:25.984975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 581/1162] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:25.991285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:25.991712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:25.991818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:26.009607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:26.010808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:26.078581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 582/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:36:26.343292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af1ef5-ca51-4919-870e-f481fcefac3e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:26.453419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af1ef5-ca51-4919-870e-f481fcefac3e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:26.487851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:26.488433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:26.488706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:26.488969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:26.557905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:26.569432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:26.570924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:26.676710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 582/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:26.682874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:26.789717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772b1e0-5329-43d4-9eb2-8b723b87f9ee None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:26.818551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:26.824926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:26.825544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:26.825819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:26.826083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:26.833319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:26.834800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-b247cdc8-22d1-46ad-9d52-05af7ba0aef2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:26.846811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:26.847948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:36:26.849110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 583/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:36:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:26.853963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:26.945920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:26.956373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e82e6-bd4d-4413-9397-4b88066fe842 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:26.993113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:26.993712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:26.993993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:26.994266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:26.994950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:26.995254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:26.996648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459dbaa-2523-44e9-9747-f156913ef384 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:27.004203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 583/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 10:36:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:28.872462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc1bd-46c7-4e7d-8b40-f9b9c15b6d08 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:28.873298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc1bd-46c7-4e7d-8b40-f9b9c15b6d08 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:28.873298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cc1bd-46c7-4e7d-8b40-f9b9c15b6d08 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:28.875478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 584/1167] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:28.883371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbda84-d5e5-45d8-89c7-295805e8c884 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:28.883805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbda84-d5e5-45d8-89c7-295805e8c884 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:28.883892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbda84-d5e5-45d8-89c7-295805e8c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:28.903639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e5cbda84-d5e5-45d8-89c7-295805e8c884 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:28.904822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e5cbda84-d5e5-45d8-89c7-295805e8c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:28.973702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 584/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:36:29.242633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cc1bd-46c7-4e7d-8b40-f9b9c15b6d08 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:29.378492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cc1bd-46c7-4e7d-8b40-f9b9c15b6d08 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:29.413360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85a75e-10a2-4955-b5a3-42549b727158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:29.413948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85a75e-10a2-4955-b5a3-42549b727158 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:29.414223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85a75e-10a2-4955-b5a3-42549b727158 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:29.414492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85a75e-10a2-4955-b5a3-42549b727158 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:29.415198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85a75e-10a2-4955-b5a3-42549b727158 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:29.416568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85a75e-10a2-4955-b5a3-42549b727158 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:29.435373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 585/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Fri Aug 12 10:36:29 2022] POST /identity/v3/domains => generated 267 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:36:31.314941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237bb6c-2dbf-4123-92d6-6d36a26e7cab None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:31.315727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237bb6c-2dbf-4123-92d6-6d36a26e7cab None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:31.315727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237bb6c-2dbf-4123-92d6-6d36a26e7cab None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:31.317024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 585/1170] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:31.322574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:31.323034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:31.323141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:31.342406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:31.343602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:31.395961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:31.421120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 586/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:31.689552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237bb6c-2dbf-4123-92d6-6d36a26e7cab None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:31.780774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:31.804785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237bb6c-2dbf-4123-92d6-6d36a26e7cab None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:31.840045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656cb5-2a63-40d0-887b-347f8e7d2ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:31.840660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656cb5-2a63-40d0-887b-347f8e7d2ed0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:31.840932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656cb5-2a63-40d0-887b-347f8e7d2ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:31.841200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656cb5-2a63-40d0-887b-347f8e7d2ed0 None admin] PATH_INFO: `/v3/domains/527db8924f01455ab5caea1a0a342937` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:31.852394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656cb5-2a63-40d0-887b-347f8e7d2ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=527db8924f01455ab5caea1a0a342937)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:31.853842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656cb5-2a63-40d0-887b-347f8e7d2ed0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:31.855433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 586/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Aug 12 10:36:31 2022] GET /identity/v3/domains/527db8924f01455ab5caea1a0a342937 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:31.861483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:31.974132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8d52e-234a-45e3-a8d7-1966e0495dcd None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:32.018790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be1b93-aeb7-496d-acbf-20af5254be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:32.019390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1b93-aeb7-496d-acbf-20af5254be1b None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:32.019665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1b93-aeb7-496d-acbf-20af5254be1b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:32.019971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be1b93-aeb7-496d-acbf-20af5254be1b None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:32.020624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1b93-aeb7-496d-acbf-20af5254be1b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:32.022054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be1b93-aeb7-496d-acbf-20af5254be1b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:32.051236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 587/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:36:31 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:36:33.928615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02561-3683-455d-b16f-0204471ffd67 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:33.929205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02561-3683-455d-b16f-0204471ffd67 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:33.929205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de02561-3683-455d-b16f-0204471ffd67 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:33.931304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 587/1174] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:33.940373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:33.940779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:33.940984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:33.960929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:33.962088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:33.989133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:34.035024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 588/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:34.301649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02561-3683-455d-b16f-0204471ffd67 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:34.420430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de02561-3683-455d-b16f-0204471ffd67 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:34.454492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc52af-34c5-47b4-aec8-045afe494904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:34.455144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc52af-34c5-47b4-aec8-045afe494904 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:34.455383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc52af-34c5-47b4-aec8-045afe494904 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:34.455692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc52af-34c5-47b4-aec8-045afe494904 None admin] PATH_INFO: `/v3/domains/527db8924f01455ab5caea1a0a342937` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:34.456871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc52af-34c5-47b4-aec8-045afe494904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=527db8924f01455ab5caea1a0a342937)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:34.458308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc52af-34c5-47b4-aec8-045afe494904 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:34.459885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 588/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Aug 12 10:36:34 2022] GET /identity/v3/domains/527db8924f01455ab5caea1a0a342937 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:34.466032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:34.565639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ec2fd-9988-4d6b-aa1c-076f38cc23ad None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:34.607805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d69fc5-a6d2-4f89-a473-1e5b78d513c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:34.608681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d69fc5-a6d2-4f89-a473-1e5b78d513c6 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:34.609066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d69fc5-a6d2-4f89-a473-1e5b78d513c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:34.609431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d69fc5-a6d2-4f89-a473-1e5b78d513c6 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:34.610407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d69fc5-a6d2-4f89-a473-1e5b78d513c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:34.612758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d69fc5-a6d2-4f89-a473-1e5b78d513c6 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:34.640871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 589/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:36:34 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:36:36.540942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3de27-5ec1-4d55-bef2-eec00a3a5213 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:36.541510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3de27-5ec1-4d55-bef2-eec00a3a5213 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:36.541608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3de27-5ec1-4d55-bef2-eec00a3a5213 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:36.543860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 589/1178] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:36.551644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:36.552118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:36.552215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:36.571266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:36.572435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:36.585562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:36.651142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 590/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:36:36.919625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3de27-5ec1-4d55-bef2-eec00a3a5213 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:36.937055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:37.029991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3de27-5ec1-4d55-bef2-eec00a3a5213 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:37.063987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:37.064606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:37.064881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:37.065176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:37.076073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:36:37.080838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:37.081974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:36:37.082953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 590/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:37.088302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:37.202054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb231bb-2e48-4c24-87ec-77b97a156d4f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:37.237256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:37.237853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:37.238127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:37.238400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:37.239094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:37.239390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:37.240750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:37.249002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 591/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:37.255190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:37.330590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:37.363589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89b3a2-399d-496d-ac19-2783df6e4ec2 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:37.406286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:37.407197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:37.407572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:37.407937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] PATH_INFO: `/v3/users/912f524525a6465586e3e1677cc2bc9a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:37.421643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] RBAC: Authorizing `identity:get_user(user_id=912f524525a6465586e3e1677cc2bc9a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:37.423122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:37.424736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 591/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:37 2022] GET /identity/v3/users/912f524525a6465586e3e1677cc2bc9a => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:36:37.431097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:37.444403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:37.536616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf782817-d2b0-4e73-8138-3d2c91670be0 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:37.571184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:37.571789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:37.572032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:37.572299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:37.645588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:37.647079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:37.659275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:37.773535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 592/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:37.783213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:37.896178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26058e73-86a3-4ed1-83ad-9c4019c64879 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:37.931726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:37.939115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3c21b-1317-473e-8aa1-45abd6ee798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:37.939736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3c21b-1317-473e-8aa1-45abd6ee798f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:37.940010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3c21b-1317-473e-8aa1-45abd6ee798f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:37.940274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3c21b-1317-473e-8aa1-45abd6ee798f None admin] PATH_INFO: `/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:37.941494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3c21b-1317-473e-8aa1-45abd6ee798f None admin] RBAC: Authorizing `identity:get_project(project_id=43ae9eddbcbd4f798917f0d812fc1cb5)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:37.942979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3c21b-1317-473e-8aa1-45abd6ee798f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:37.944616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 592/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:37 2022] GET /identity/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:37.951138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:38.067894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aa2c0-2a5b-4f26-9881-bc62ede3157a None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:38.078504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:38.102460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:38.103160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:38.103436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:38.103704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:38.104413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=43ae9eddbcbd4f798917f0d812fc1cb5, user.id=912f524525a6465586e3e1677cc2bc9a) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:38.104715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:38.106140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1406b5b7-590c-4a99-94c4-23149a8315cd None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:38.111885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 593/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:36:37 2022] GET /identity/v3/role_assignments?user.id=912f524525a6465586e3e1677cc2bc9a&scope.project.id=43ae9eddbcbd4f798917f0d812fc1cb5&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:39.970236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef59617-7a11-4ab3-a964-a4b671b12535 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:39.971157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef59617-7a11-4ab3-a964-a4b671b12535 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:39.971157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef59617-7a11-4ab3-a964-a4b671b12535 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:39.973289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 593/1186] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:39.981354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:39.981779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:39.981879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:40.002116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:40.003354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:40.082008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 594/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:36:40.352170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef59617-7a11-4ab3-a964-a4b671b12535 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:40.462144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef59617-7a11-4ab3-a964-a4b671b12535 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:40.497010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:40.497621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:40.497892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:40.498162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:40.508939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:36:40.513566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:40.514641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:36:40.516100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 594/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:40.521683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:40.641396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011c308-5658-4f88-8c04-4864c08d4de5 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:40.645669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:40.690854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:40.691457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:40.691732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:40.692004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:40.692666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:40.692971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:40.694332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:40.702533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 595/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:40.708799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:40.771668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:40.820718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6943517-0ec6-4383-be11-521d81c1f00d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:40.852887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:40.853501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:40.853774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:40.854036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] PATH_INFO: `/v3/users/912f524525a6465586e3e1677cc2bc9a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:40.855223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] RBAC: Authorizing `identity:get_user(user_id=912f524525a6465586e3e1677cc2bc9a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:40.856640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:40.858163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 595/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:40 2022] GET /identity/v3/users/912f524525a6465586e3e1677cc2bc9a => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:40.865815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:40.974456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd8a9c-b2d4-41ab-8a6f-3004846284c9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:41.011023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025bc7f-edd7-40a0-b5d6-8dd809055d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:41.011642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025bc7f-edd7-40a0-b5d6-8dd809055d04 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:41.011917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025bc7f-edd7-40a0-b5d6-8dd809055d04 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:41.012185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025bc7f-edd7-40a0-b5d6-8dd809055d04 None admin] PATH_INFO: `/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:41.013309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025bc7f-edd7-40a0-b5d6-8dd809055d04 None admin] RBAC: Authorizing `identity:get_project(project_id=43ae9eddbcbd4f798917f0d812fc1cb5)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:41.014768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025bc7f-edd7-40a0-b5d6-8dd809055d04 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:41.016704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 596/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:40 2022] GET /identity/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:36:41.023035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:41.141805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8137a5-4f63-40a3-ae4d-94fca4e584b3 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:41.169195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:41.183200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7621db-3a36-4119-9489-f7ca5c95d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:41.184166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7621db-3a36-4119-9489-f7ca5c95d84a None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:41.184546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7621db-3a36-4119-9489-f7ca5c95d84a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:41.184883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7621db-3a36-4119-9489-f7ca5c95d84a None admin] PATH_INFO: `/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5/users/912f524525a6465586e3e1677cc2bc9a/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:41.187779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7621db-3a36-4119-9489-f7ca5c95d84a None admin] RBAC: Authorizing `identity:create_grant(project_id=43ae9eddbcbd4f798917f0d812fc1cb5, user_id=912f524525a6465586e3e1677cc2bc9a, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:41.190025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7621db-3a36-4119-9489-f7ca5c95d84a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:41.204496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 596/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:36:41 2022] PUT /identity/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5/users/912f524525a6465586e3e1677cc2bc9a/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:36:43.041695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac86bd-ae14-4643-b449-ef66b19545c3 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:43.042198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac86bd-ae14-4643-b449-ef66b19545c3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:43.042288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac86bd-ae14-4643-b449-ef66b19545c3 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:43.043611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 597/1193] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:36:43.051457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:43.051868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:43.051972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:43.071420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:36:43.072596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:36:43.145182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 597/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:36:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:36:43.414523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac86bd-ae14-4643-b449-ef66b19545c3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:43.454753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:43.524726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac86bd-ae14-4643-b449-ef66b19545c3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:43.560123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:43.560725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:43.560999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:43.561265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:43.572895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:36:43.577471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:36:43.578561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:36:43.579730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 598/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:36:43.587333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:43.695643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca534691-2454-4e0a-831d-670ba6e22f74 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:43.711688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:43.736044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:43.736953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:43.737291 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:43.737562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:43.738235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:43.738538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:43.739948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:43.748353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 598/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:43.754349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:43.848742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:43.855642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcf7c-f349-44a2-bf28-14b5ced1c1a8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:43.894103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:43.894720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:43.895011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:43.895279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] PATH_INFO: `/v3/users/912f524525a6465586e3e1677cc2bc9a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:43.896426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] RBAC: Authorizing `identity:get_user(user_id=912f524525a6465586e3e1677cc2bc9a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:43.897856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:43.899449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 599/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 10:36:43 2022] GET /identity/v3/users/912f524525a6465586e3e1677cc2bc9a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:43.905589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:44.007436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74336f4-9d3a-4a2e-a9a6-ef3ab6696086 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:44.041848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:44.042478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:44.042783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:44.043048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:44.088601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:44.117825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:44.119313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:44.227325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 599/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:36:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:36:44.235839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:44.347248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c2432-f184-4b53-9997-78bae487ec91 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:44.381137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44abed-de0c-4e17-9408-43bb9e624961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:44.381749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44abed-de0c-4e17-9408-43bb9e624961 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:44.382000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44abed-de0c-4e17-9408-43bb9e624961 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:44.382285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44abed-de0c-4e17-9408-43bb9e624961 None admin] PATH_INFO: `/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:44.383555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44abed-de0c-4e17-9408-43bb9e624961 None admin] RBAC: Authorizing `identity:get_project(project_id=43ae9eddbcbd4f798917f0d812fc1cb5)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:44.384978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44abed-de0c-4e17-9408-43bb9e624961 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:44.386573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 600/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 10:36:44 2022] GET /identity/v3/projects/43ae9eddbcbd4f798917f0d812fc1cb5 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:44.393656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:36:44.475610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:44.502223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537fbe-d6be-4d0a-89d6-f2aa17c6b3a2 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:36:44.547333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:36:44.548668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:36:44.549388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:36:44.549975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:36:44.551240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=43ae9eddbcbd4f798917f0d812fc1cb5, user.id=912f524525a6465586e3e1677cc2bc9a) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:36:44.551549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:36:44.552994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6df58-c3f9-4e6d-8f0a-9d4935702fb7 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:36:44.562157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 600/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:36:44 2022] GET /identity/v3/role_assignments?user.id=912f524525a6465586e3e1677cc2bc9a&scope.project.id=43ae9eddbcbd4f798917f0d812fc1cb5&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:36:54.375875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=85 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:36:54.557178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=29 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:39.464962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217cf54-22d8-44ab-b6e3-3aa6e50f01ff None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:39.465597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217cf54-22d8-44ab-b6e3-3aa6e50f01ff None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:39.465597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217cf54-22d8-44ab-b6e3-3aa6e50f01ff None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:39.466953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 601/1201] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:37:39.473117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:39.473662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:39.473662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:39.501212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:37:39.502472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:37:39.584388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 601/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:37:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:37:39.854636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217cf54-22d8-44ab-b6e3-3aa6e50f01ff None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:39.984575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217cf54-22d8-44ab-b6e3-3aa6e50f01ff None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:40.025674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:40.026324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:40.026653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:40.026967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:40.039086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:40.040690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:40.057539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:40.058636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:40.060208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:40.060208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:40.060208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:40.061680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 602/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:40.067999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:40.199617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72254cb-4786-4925-8fcd-134fd2ae124c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:40.239142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:40.246375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:40.247231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:40.247688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:40.248112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:40.248904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:40.249351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:40.250918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9260e5-93ba-4955-a9ef-9a58df049483 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:40.265104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 602/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:40.271537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:40.347686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:40.414379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bf62f-518e-4523-8af2-d17d7cf04098 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:40.457048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274c8eb-57b5-4f1d-9278-cf9e1059c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:40.457960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c8eb-57b5-4f1d-9278-cf9e1059c840 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:40.458445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c8eb-57b5-4f1d-9278-cf9e1059c840 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:40.458964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274c8eb-57b5-4f1d-9278-cf9e1059c840 None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:40.460089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c8eb-57b5-4f1d-9278-cf9e1059c840 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:40.462073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a274c8eb-57b5-4f1d-9278-cf9e1059c840 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:40.493257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 603/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 10:37:40 2022] POST /identity/v3/users => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:37:42.586115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34a52-a7de-4966-adb6-6e95c7924014 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:42.586726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34a52-a7de-4966-adb6-6e95c7924014 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:42.586726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd34a52-a7de-4966-adb6-6e95c7924014 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:42.588267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 603/1206] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:37:42.593352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:42.594854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:42.594854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:42.614996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:37:42.616189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:37:42.690922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 604/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:37:42.944875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34a52-a7de-4966-adb6-6e95c7924014 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:43.082058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd34a52-a7de-4966-adb6-6e95c7924014 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:43.126807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:43.127474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:43.127752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:43.128000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:43.139698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:37:43.145500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:43.146626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:43.147622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 604/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:37:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:43.153028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:43.199362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:43.268144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb077-a99a-4c1f-9061-9b922c102463 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:43.308863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:43.309477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:43.309862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:43.310077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:43.310784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:43.311125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:43.312494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:43.321558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 605/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:37:43.327828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:43.396528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:43.459937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6f841-13d9-4e6c-b998-13d50bb86999 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:43.498411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:43.499024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:43.501316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:43.501316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:43.515295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:43.517037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:43.536762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:43.537787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:43.538731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:43.538731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:43.538731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:43.538731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 605/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:43.543921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:43.652032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:43.656086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09cbdb-2b1d-451a-89ec-80f18e534d69 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:43.691617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:43.692768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:43.692768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:43.692768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:43.693410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:43.693766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:43.695132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:43.711569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 606/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:43.720451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:43.835008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07e975-8def-42e1-85f2-7e6e5c681e3a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:43.836643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:43.869407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:43.871438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:43.871438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:43.871438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:43.880010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:43.881504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:37:43.895129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:43.896207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:43.897383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 606/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:37:43.903402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:44.022770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226db33c-bdf1-47a6-a1a6-914b5a581685 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:44.062246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:44.062942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:44.064444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:44.064444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:44.064444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:44.064742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:44.066228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:44.084915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 607/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 10:37:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:37:44.090423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:44.198469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6d9a-3463-42df-82ab-117a8bfba041 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:44.243625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:44.244150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:44.244424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:44.244689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:44.279399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:44.323469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:44.324896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:44.448095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 607/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:37:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 10:37:44.453747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:44.473816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:44.559464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867cd3d-ec02-4477-b18e-f8a1f4ccd8fb None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:44.602797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:44.602797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:44.602797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:44.602797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:44.612886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:44.614426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:44.631540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:44.632811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:44.633728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:44.633728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:44.633728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:44.633728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 608/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:37:44.641070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:44.707705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:44.755677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3e53e-653f-4ac7-af18-321c656fff5d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:44.794154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:44.794800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:44.796341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:44.796341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:44.796341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:44.796341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:44.797631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:44.817745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 608/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:44.817950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:44.900528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:44.932432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee44e8-1406-4aba-aa50-2d29a185905b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:44.972085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:44.972720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:44.973001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:44.973274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:44.983227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:44.986393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:37:45.000065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:45.001618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:45.002934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 609/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:37:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:45.007244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:45.115958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a71330-57aa-4759-8b20-1cc440cdd045 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:45.139695 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:45.152494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:45.153094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:45.153370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:45.153685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:45.154372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:45.154804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:45.156242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4490d-e660-4f77-af94-5222743dfe9b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:45.168222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 609/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:45.174507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:45.290769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde6f97-9c5e-4919-87a2-4e55e0caa1ea None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:45.320862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:45.329395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:45.330003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:45.330378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:45.330629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:45.331408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=773a76b9319a4e18b1bcff3cb85d0a64) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:45.331717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:45.333139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f009f-34c0-49cc-a332-30ef8d8a03c8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:45.339217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 610/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:37:45 2022] GET /identity/v3/role_assignments?user.id=773a76b9319a4e18b1bcff3cb85d0a64&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:47.197563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c25a6-5953-4496-be15-84b506f92265 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:47.198118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c25a6-5953-4496-be15-84b506f92265 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:47.198118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c25a6-5953-4496-be15-84b506f92265 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:47.199952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 610/1220] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:37:47.206206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:47.206846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:47.206846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:47.228035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:37:47.229519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:37:47.303259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 611/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:37:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:37:47.561670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c25a6-5953-4496-be15-84b506f92265 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:47.675588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c25a6-5953-4496-be15-84b506f92265 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:47.708603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:47.709220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:47.709485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:47.709748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:47.720107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:37:47.724824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:47.726065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:47.727145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 611/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:47.732099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:47.836741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ea59-7c35-4e96-b6b9-d84d1a809633 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:47.863485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:47.876434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:47.877133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:47.877411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:47.877691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:47.878349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] RBAC: Adding query filter params (name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:47.878650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:47.880056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:47.887907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 612/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:37:47.894234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:47.938310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:48.000826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a390bea-5789-43e2-ba0d-2f3fb1a494b5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:48.036946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:48.037581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:48.037859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:48.038127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:48.048679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:48.050405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:48.067909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:48.069059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:48.070126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:48.070126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:48.070126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:48.070840 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 612/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:48.074976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:48.191496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf36de5-cfd6-4cb7-b8e0-861ed428da09 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:48.226502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:48.227327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:48.227435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:48.227645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:48.228277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:48.228577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:48.229921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:48.245194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 613/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:48.252155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:48.351001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:48.358462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57a8c9-e41b-404c-bc8a-7336a2f23dfd None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:48.396573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:48.397223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:48.397497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:48.397770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:48.405265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:48.406730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:37:48.418936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:48.420077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:48.421235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 613/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:48.426967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:48.473934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:48.529380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8bab6-0806-4f15-bcf7-806a394cf3e9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:48.565030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:48.565755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:48.566032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:48.566361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:48.567059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:48.567356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:48.568789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:48.587827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 614/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 10:37:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:48.593430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:48.704165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a211-39ae-440d-b71e-bf70638e6655 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:48.743011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:48.743744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:48.744021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:48.744390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:48.756501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:48.758189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:48.773993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:48.775034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:48.775977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:48.775977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:48.775977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:48.775977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 614/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:48.781836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:48.896565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac88e1-94a7-494c-b469-b649d8cdf99d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:48.899207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:48.936394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:48.937127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:48.937404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:48.937672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:48.938429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:48.938786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:48.940229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:48.953727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 615/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:48.959683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:48.970883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:49.062990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fd515-c659-433d-8a94-f7a515bab695 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:49.098872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:49.099511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:49.099814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:49.100103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:49.107142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:49.108555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:37:49.122145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:49.123377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:49.124449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:49.128834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 615/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:49.130027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:49.248026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620aa069-bf32-4b9b-8d2f-ed05c7217431 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:49.292035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:49.292648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:49.293004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:49.293273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:49.293969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:49.294273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:49.295747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7bf1b-746c-4d61-be51-c0bc9164f9a7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:49.309911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 616/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:37:49.316518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:49.387149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:49.424448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3244f9-c20f-4771-94e8-785e2ae20636 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:49.459232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6584fb-74f1-431d-a8a3-1eb79f4277d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:49.459997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6584fb-74f1-431d-a8a3-1eb79f4277d0 None admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:49.460280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6584fb-74f1-431d-a8a3-1eb79f4277d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:49.460548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6584fb-74f1-431d-a8a3-1eb79f4277d0 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/773a76b9319a4e18b1bcff3cb85d0a64/roles/52a2f815541e4a3fa67cc07a8934ae53` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:49.475913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6584fb-74f1-431d-a8a3-1eb79f4277d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=773a76b9319a4e18b1bcff3cb85d0a64, role_id=52a2f815541e4a3fa67cc07a8934ae53)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:49.477555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6584fb-74f1-431d-a8a3-1eb79f4277d0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:49.491041 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 616/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:37:49 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/773a76b9319a4e18b1bcff3cb85d0a64/roles/52a2f815541e4a3fa67cc07a8934ae53 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:37:51.347492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba596a-3ae7-44b7-b279-89056f414562 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:51.348097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba596a-3ae7-44b7-b279-89056f414562 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:51.348097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba596a-3ae7-44b7-b279-89056f414562 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:51.349406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 617/1233] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:37:51.354874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369193d-a293-48fe-acb0-3388830846cb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:51.355391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369193d-a293-48fe-acb0-3388830846cb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:51.355391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369193d-a293-48fe-acb0-3388830846cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:51.376468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b369193d-a293-48fe-acb0-3388830846cb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:37:51.377918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b369193d-a293-48fe-acb0-3388830846cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:37:51.470725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 617/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:37:51.727816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba596a-3ae7-44b7-b279-89056f414562 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:51.753532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:51.831493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba596a-3ae7-44b7-b279-89056f414562 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:51.865430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:51.866057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:51.866336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:51.866598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:51.877256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:37:51.881986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:51.883168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:51.884214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 618/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 10:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:51.891525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369193d-a293-48fe-acb0-3388830846cb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:51.941891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:51.998736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369193d-a293-48fe-acb0-3388830846cb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:52.036866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:52.037486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:52.037750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:52.038025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:52.038728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:52.039045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:52.040417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:52.051614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 618/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 10:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:52.059346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:52.156633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:52.173977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf7e1-3504-4dc7-a357-540014c9a4bd None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:52.210197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:52.210864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:52.211145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:52.211418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:52.222193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:52.223787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:52.239033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:52.240264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:52.241379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:52.241379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:52.241379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:52.241379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 619/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:52.246168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:52.350626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eecc48-26a3-4a15-abda-c2fbdc08f3a8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:52.359985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:52.386552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:52.387317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:52.387701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:52.388093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:52.388855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:52.389259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:52.390753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:52.404769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 619/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:52.410564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:52.524184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337930a7-860b-43b8-b6ad-4fd4c60f23c8 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:52.560493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:52.561160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:52.561432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:52.561697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:52.564623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:52.570078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:52.571556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:37:52.587457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:52.588882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:52.590622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 620/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:52.595314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:52.719438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b36c5-c87d-41ab-b0f5-563e35153c87 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:52.756863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:52.757477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:52.757778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:52.758117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:52.759002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:52.759284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:52.761045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:52.780235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 620/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 10:37:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:52.786533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:52.899371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c28e5-2bfc-46e4-bce5-676189235f16 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:52.937449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:52.938129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:52.938408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:52.938700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:53.003425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:53.010570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:53.012064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:53.123858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 621/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:37:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:37:53.125444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:53.156481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:53.234917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a589ac2-e763-43ac-bb0a-8b8fcfaa44db None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:53.272786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:53.273414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:53.273684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:53.273946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:53.284125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:53.285697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:53.301434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:53.302390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:53.303359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:53.303359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:53.303359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:53.303359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 621/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:53.308363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:53.405641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:53.413466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae034b4-0b89-4e77-8743-38aa5ea24708 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:53.452947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:53.453623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:53.453907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:53.454250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:53.454958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:53.455364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:53.456724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:53.468987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 622/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:53.475757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:53.570799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:53.596724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e56b0-0276-4ca1-b677-af0e88801ea5 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:53.635835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:53.636644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:53.636926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:53.637259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:53.646146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:53.647797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:37:53.661939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:53.663287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:53.664324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 622/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:37:53.669945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:53.784656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9005b54-65fe-448a-92ed-096317eafc9e None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:53.826405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:53.827103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:53.827390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:53.827659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:53.828355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:53.828657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:53.830118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa223e5-33f4-4c04-a1db-eb08b508ad44 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:53.843981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 623/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:37:53.850358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:53.961104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71570c06-59ee-4c75-bea9-43db043e1586 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:53.998556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:53.999194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:53.999465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:53.999729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:54.000451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] RBAC: Adding query filter params (role.id=52a2f815541e4a3fa67cc07a8934ae53, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=773a76b9319a4e18b1bcff3cb85d0a64) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:54.000754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:54.002231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00117508-b3b1-462d-baa6-565c11d9794d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:54.007989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 623/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:37:53 2022] GET /identity/v3/role_assignments?user.id=773a76b9319a4e18b1bcff3cb85d0a64&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=52a2f815541e4a3fa67cc07a8934ae53 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:55.974743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f272f-8127-47c5-bc2e-3d4b574f29c2 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:55.975316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f272f-8127-47c5-bc2e-3d4b574f29c2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:55.975316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f272f-8127-47c5-bc2e-3d4b574f29c2 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:55.976914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 624/1247] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:37:55.981810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:55.982273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:55.982348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:55.988881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:56.005441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:37:56.006763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:37:56.075968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 624/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:37:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:37:56.366975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f272f-8127-47c5-bc2e-3d4b574f29c2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:56.387708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:56.485579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f272f-8127-47c5-bc2e-3d4b574f29c2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:56.532669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:56.533378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:56.533649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:56.533913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:56.546785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:37:56.552001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:56.553203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:56.554379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 625/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:56.559569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:56.677129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0219e61-1fb0-4de1-91b9-7b9405af0593 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:56.710619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:56.717422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:56.718048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:56.718350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:56.718638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:56.719352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:56.719676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:56.721169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:56.731715 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 625/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:56.737796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:56.830463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:56.856754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a66c-7ae0-4584-9ba6-c2b3f5cb8415 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:56.893108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:56.893754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:56.894031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:56.894299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:56.904650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:56.906096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:56.921808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:56.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:56.924068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:56.924068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:56.924068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:56.924068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 626/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:56.929500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:57.051078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb627-a7a3-4d63-a7fb-0e5732eda355 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:57.088859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:57.089473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:57.089758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:57.090058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:57.090854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:57.091184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:57.093257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:57.107458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 626/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:57.114888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:57.232431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf0377-c664-4f11-9f85-fd9a31916cab None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:57.260727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:57.269558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:57.270201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:57.270478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:57.270786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:57.281010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:57.282761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:37:57.295640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:57.296795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:37:57.298079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 627/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:57.303701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:57.368341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:57.419328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e6aa-d083-4109-8f96-d95967cdfbf0 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:57.460993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:57.461629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:57.461894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:57.462158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:57.462929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:57.463239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:57.464683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:57.490110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 627/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 10:37:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:57.496618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:57.610288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434c199-bef1-40dd-a48c-783d9cd4436b None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:57.650134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:57.650855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:57.651230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:57.651544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:57.717374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:57.732435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:57.734251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:57.838394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 628/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:37:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:37:57.844566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:57.962404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf8361-d7eb-4cf7-b249-04fe8370ea4f None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:57.978343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:58.003369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:58.004053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:58.004337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:58.004575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:58.015488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:58.017269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:37:58.033805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:58.035022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:37:58.036490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:37:58.036490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:37:58.036490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:58.036490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 628/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:58.041054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:58.142378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:58.157123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d1cd3-b87c-48b7-b39c-aad9b8526543 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:58.193326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:58.193970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:58.194251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:58.194522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:58.195358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:58.195764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:58.197461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:58.212033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 629/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:58.218665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:58.322196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f54f6-2f42-4b9f-a771-16bcbf5cd418 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:58.362328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:58.363067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:58.363346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:58.363632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:58.371506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:58.373108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:37:58.387261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:37:58.388396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:37:58.389769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 629/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:37:58.396048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:58.501071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1a94-29e4-41a7-ab10-cbe77d9d64df None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:58.540134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:58.540885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:58.541296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:58.541617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:58.542517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:58.542854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:58.544605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9b553-326d-4a5d-b6d0-6974ec955e76 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:58.559324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 630/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:37:58.566030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:37:58.595192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:37:58.698339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572671b-d87b-4d2a-832c-7b274c2c238c None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:37:58.733996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:37:58.734639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:37:58.734958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:37:58.735208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:37:58.735940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=773a76b9319a4e18b1bcff3cb85d0a64) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:37:58.736244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:37:58.737797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e68b7-a827-43ec-a3b2-c52b6f7caca3 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:37:58.744207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 630/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:37:58 2022] GET /identity/v3/role_assignments?user.id=773a76b9319a4e18b1bcff3cb85d0a64&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:00.587831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58e7a-b32f-41ad-8d92-c136f0ffed34 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:00.588688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58e7a-b32f-41ad-8d92-c136f0ffed34 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:00.588688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58e7a-b32f-41ad-8d92-c136f0ffed34 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:00.590836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 631/1261] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:38:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:38:00.598355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:00.598761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:00.598970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:00.619104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:38:00.620312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:38:00.693032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 631/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:38:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:38:00.955740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58e7a-b32f-41ad-8d92-c136f0ffed34 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:00.973748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:01.071290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58e7a-b32f-41ad-8d92-c136f0ffed34 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:01.106978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:01.107586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:01.107860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:01.108124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:01.118945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:38:01.123533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:01.124617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:01.125650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 632/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:01.130973 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:01.150424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:01.236359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe619b-8c73-44dd-ba49-21517d126704 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:01.274144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:01.274736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:01.275040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:01.275310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:01.275978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:01.276272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:01.277648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:01.285644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 632/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:38:01.295202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:01.364053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:01.401135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eab4a8-ed3d-4876-a3bc-802b47d481f9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:01.436466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:01.437075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:01.437348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:01.437616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:01.449064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:01.450558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:38:01.466051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:01.467129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:38:01.468183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:38:01.468183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:01.468183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:01.468183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 633/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:01.473218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:01.555194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:01.577561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898a463-2227-42fc-aa8b-300d0ee8d205 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:01.615152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:01.616015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:01.616015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:01.616280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:01.616912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:01.617195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:01.618553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:01.630741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 633/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:01.637224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:01.737541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e318c2-c53a-426b-8475-fcaf7d930718 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:01.757392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:01.776113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:01.776723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:01.776992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:01.777251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:01.785125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:01.786582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:38:01.797979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:01.799176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:01.800326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 634/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:38:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:01.805354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:01.922058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb12d4-db3b-42d2-893f-5537cf3c0e70 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:01.960694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:01.961279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:01.961551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:01.961817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:01.962526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:01.962854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:01.964270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:01.973648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:01.982787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 634/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 10:38:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:01.988560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:02.088157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca80e58-191f-4510-b98c-506433e9f8f2 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:02.122799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:02.123417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:02.123692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:02.123963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:02.135208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:02.136652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:38:02.151540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:02.152602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:38:02.153512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:38:02.153512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:02.153512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:02.153512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 635/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:02.159340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:02.280876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64198fca-b30c-413f-8364-7ae3a84fb491 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:02.321286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:02.321874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:02.322148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:02.322413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:02.323081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:02.323383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:02.324747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:02.335894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 635/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:02.341753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:02.374119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:02.453322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a08a2c-4fae-44f1-84ad-acde72aef4e1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:02.489527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:02.490146 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:02.490429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:02.490716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:02.498470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:02.499945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:38:02.512378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:02.513357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:02.514425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 636/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:38:02.520013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:02.580073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:02.624196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aaf98-9eee-40b4-9f86-a8d150e3e85a None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:02.658349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:02.658979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:02.659268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:02.659535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:02.660224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:02.660526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:02.661962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902775b-52bc-4ffd-8b87-9d2758902ceb None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:02.674100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 636/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:02.683109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:02.790947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:02.800587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66863e81-99b0-445f-acda-f6289b152036 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:02.836641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce01737-7a86-482f-8ab8-9b13845ddfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:02.837297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce01737-7a86-482f-8ab8-9b13845ddfb5 None admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:02.837577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce01737-7a86-482f-8ab8-9b13845ddfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:02.837855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce01737-7a86-482f-8ab8-9b13845ddfb5 None admin] PATH_INFO: `/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/773a76b9319a4e18b1bcff3cb85d0a64/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:02.839814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce01737-7a86-482f-8ab8-9b13845ddfb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=645bc74c5a1e42a6a58067b78bd0c1cc, user_id=773a76b9319a4e18b1bcff3cb85d0a64, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:02.841293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce01737-7a86-482f-8ab8-9b13845ddfb5 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:02.856668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 637/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 10:38:02 2022] PUT /identity/v3/projects/645bc74c5a1e42a6a58067b78bd0c1cc/users/773a76b9319a4e18b1bcff3cb85d0a64/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:38:04.699356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013b429-5589-4d30-a72e-006d4ce71d9a None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:04.700019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013b429-5589-4d30-a72e-006d4ce71d9a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:04.700019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013b429-5589-4d30-a72e-006d4ce71d9a None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:04.701214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 637/1274] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:38:04.707694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:04.708152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:04.708248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:04.738008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:38:04.739222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:38:04.819032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 638/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:38:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:38:05.081953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013b429-5589-4d30-a72e-006d4ce71d9a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:05.204499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013b429-5589-4d30-a72e-006d4ce71d9a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:05.231325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:05.251604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:05.252247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:05.252522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:05.252784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:05.265205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 10:38:05.270210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:05.271363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:05.272464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 638/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 10:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:05.277680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:05.363266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:05.383682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243477-aa34-484e-95c0-8f12e47ea229 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:05.419811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:05.420397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:05.420670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:05.420930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:05.421595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:05.421885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:05.423273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:05.431264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 639/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 10:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:05.437381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:05.550171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6be01-6eb5-45b8-b549-dcca04f79c7b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:05.584345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:05.584929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:05.585198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:05.585460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:05.595380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:05.596837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:38:05.617850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:05.619290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:38:05.620755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:38:05.620755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:05.620755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:05.620755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 639/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:05.626973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:05.734994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c829a4-2ae8-4b03-a2de-583fa672b09d None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:05.771131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:05.771716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:05.771990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:05.772230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:05.772883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:05.773176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:05.774530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:05.787377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 640/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:05.795711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:05.831634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:05.905021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003fef9-2298-485d-81a0-f41c7b10cd1b None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:05.938896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:05.939561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:05.939834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:05.940089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:05.949883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:05.951741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 10:38:05.964831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:05.966644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:05.968269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 640/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:38:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 10:38:05.973591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:05.979322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:06.095255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d38b7-027a-489d-930c-b680ba1f31a7 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:06.132140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:06.132740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:06.133016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:06.133283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:06.134013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:06.134325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:06.135795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:06.153127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 641/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 10:38:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:06.160245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:06.268255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:06.286071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d18b2-26ef-4486-ada6-cfb22d4cbaf4 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:06.326473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:06.327110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:06.327391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:06.327660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:06.397068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:06.398447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:06.499081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:06.516403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 641/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 10:38:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 10:38:06.523453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:06.587666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:06.629019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122eb17-399e-4142-9ad0-f5fd72942cdd None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:06.666856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:06.667418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:06.667700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:06.667969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:06.678940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:06.680390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 10:38:06.695623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:06.696753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 10:38:06.698000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 10:38:06.698000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 10:38:06.698000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:06.698000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 642/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:06.702790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:06.816785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb07c780-4e33-4fec-b224-9354610d63f8 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:06.857741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:06.858343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:06.858610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:06.858913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:06.859554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:06.859837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:06.861206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:06.874788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 642/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 10:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:06.882121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:06.994299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15971d-c3e2-4d8d-bc37-50c0c2cd3c19 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:07.008178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:07.032094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:07.032710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:07.032982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:07.033284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:07.040596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:07.042021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 10:38:07.053557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:07.054591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: ERROR keystone.server.flask.application Aug 12 10:38:07.055699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 643/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 10:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:07.062785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:07.119198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:07.173638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5af8-4fea-48c9-9b41-3b34a83dd4db None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:07.210443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:07.211069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:07.211343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:07.211608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:07.212297 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:07.212596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:07.214027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b999f-18e7-4c93-983e-218d7723fa86 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:07.229026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 643/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 10:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:07.235655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:07.343399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a544a-f10d-4cf3-8508-5efa6594d8e9 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:07.378866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:07.379453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:07.379725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:07.379988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:07.380696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] RBAC: Adding query filter params (role.id=4f487b987d3d44cf853d679f27cf2032, scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc, user.id=773a76b9319a4e18b1bcff3cb85d0a64) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:07.380997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:07.382412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fa7e09-cb8e-429f-9e20-8e58cbd5ec1c None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:07.388207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 644/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 10:38:07 2022] GET /identity/v3/role_assignments?user.id=773a76b9319a4e18b1bcff3cb85d0a64&scope.project.id=645bc74c5a1e42a6a58067b78bd0c1cc&role.id=4f487b987d3d44cf853d679f27cf2032 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:09.293194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacd036-55d9-49c8-820d-75b75f6e84b4 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:09.293739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacd036-55d9-49c8-820d-75b75f6e84b4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:09.293739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacd036-55d9-49c8-820d-75b75f6e84b4 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:09.295102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 644/1288] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:38:09.301363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:09.302091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:09.302230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:09.332064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:38:09.333271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:38:09.367386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:09.410401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 645/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:38:09.676252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacd036-55d9-49c8-820d-75b75f6e84b4 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:09.782187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacd036-55d9-49c8-820d-75b75f6e84b4 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:09.792834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:09.818585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:09.819242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:09.819517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:09.819790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:09.820372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:09.821751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:09.830737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:09.831826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:09.832723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 645/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:38:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:09.838729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:09.945756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f744ab-537b-408b-867f-a375bfed714a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:09.987286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:09.987929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:09.988208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:09.988477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:09.989105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:09.989408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:09.990810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc34f88-2dc7-4725-9e8f-b13a94ac2240 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:09.995941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 646/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 10:38:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:10.001811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:10.119041 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a360fb-9d76-4508-be1d-2be7804b9c02 None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:10.154199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:10.154820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:10.155099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:10.155365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] PATH_INFO: `/v3/services` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:10.155991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:10.156287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:10.157666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d556bc2-e524-474a-a8d5-76c0ba3cdca5 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:10.162340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 646/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 10:38:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:12.026502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460df2-ebf5-40bd-b044-e078932b9775 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:12.027376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460df2-ebf5-40bd-b044-e078932b9775 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:12.027516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a460df2-ebf5-40bd-b044-e078932b9775 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:12.029600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 647/1293] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:38:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:38:12.036481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7abc3-672d-4237-ac7b-da73cab035e0 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:12.036911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7abc3-672d-4237-ac7b-da73cab035e0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:12.037042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7abc3-672d-4237-ac7b-da73cab035e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:12.066501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-26f7abc3-672d-4237-ac7b-da73cab035e0 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:38:12.067726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-26f7abc3-672d-4237-ac7b-da73cab035e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:38:12.102130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:12.145360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 647/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:38:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:38:12.415617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460df2-ebf5-40bd-b044-e078932b9775 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:12.455723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:12.539794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a460df2-ebf5-40bd-b044-e078932b9775 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:12.574957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7af596-8ad0-4477-abd7-5c901751af43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:12.575545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af596-8ad0-4477-abd7-5c901751af43 None admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:12.575820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af596-8ad0-4477-abd7-5c901751af43 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:12.576085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7af596-8ad0-4477-abd7-5c901751af43 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:12.576721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af596-8ad0-4477-abd7-5c901751af43 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:12.578078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7af596-8ad0-4477-abd7-5c901751af43 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:12.595946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 648/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 10:38:12 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:38:14.473681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c16f2-8cdf-42ea-8a20-3f13d8c78f0c None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:14.474584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c16f2-8cdf-42ea-8a20-3f13d8c78f0c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:14.474584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c16f2-8cdf-42ea-8a20-3f13d8c78f0c None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:14.476639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 648/1296] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:38:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:38:14.482028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:14.482462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:14.482561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:14.502098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:38:14.503304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:38:14.579420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 649/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:38:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 10:38:14.844287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c16f2-8cdf-42ea-8a20-3f13d8c78f0c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:14.957858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c16f2-8cdf-42ea-8a20-3f13d8c78f0c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:14.992843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:14.993466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:14.993742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:14.994007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] PATH_INFO: `/v3/services/placement` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:14.994590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:14.995997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:15.005112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:15.006231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:15.007386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:15.010928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 649/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:38:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:15.012205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:15.031214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:15.115064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068798f-bf4c-4f25-9d3c-2b543831a629 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:15.150720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:15.151332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:15.151608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:15.151876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:15.152504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:15.152805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:15.154161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:15.159457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 650/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 10:38:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:15.165680 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:15.201551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:15.287425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f2f3a-e6b1-40d8-8c75-502b3c4247af None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:15.325039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:15.325632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:15.325904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:15.326169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:15.326897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] RBAC: Adding query filter params (interface=public, service_id=46b88f8c3198425a877ea3b1c5abe87a, region_id=RegionOne) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:15.327204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:15.328569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d23b3-9903-4fdc-adca-4e6db6d1c4e2 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:15.333705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 650/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 10:38:15 2022] GET /identity/v3/endpoints?service_id=46b88f8c3198425a877ea3b1c5abe87a&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:38:15.339636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:15.424822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:15.447247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216517c-5bf1-496e-bd4c-6e0e3a3c5ce1 None admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:15.483923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702334-e1e9-49cc-a387-aed99d4afdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:15.484500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702334-e1e9-49cc-a387-aed99d4afdb3 None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:15.484780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702334-e1e9-49cc-a387-aed99d4afdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:15.485046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702334-e1e9-49cc-a387-aed99d4afdb3 None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:15.485654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702334-e1e9-49cc-a387-aed99d4afdb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:15.487089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702334-e1e9-49cc-a387-aed99d4afdb3 None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:15.493938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 651/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 10:38:15 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:38:17.337924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36125187-1f62-4a88-b35f-952c31fdee85 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:17.338604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36125187-1f62-4a88-b35f-952c31fdee85 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:17.338604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36125187-1f62-4a88-b35f-952c31fdee85 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:17.340712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 651/1302] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:38:17.348203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:17.348651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:17.348740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:17.368523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:38:17.369684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:38:17.438914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 652/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:38:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 10:38:17.706566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36125187-1f62-4a88-b35f-952c31fdee85 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:17.820755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:17.831070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36125187-1f62-4a88-b35f-952c31fdee85 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:17.870200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:17.870838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:17.871108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:17.871375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] PATH_INFO: `/v3/services/placement` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:17.871946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:17.873306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 10:38:17.882119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 10:38:17.883276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application with Lock( Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self._enter() Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application return self.creator() Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application created_value = creator( Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 10:38:17.884293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: ERROR keystone.server.flask.application Aug 12 10:38:17.886847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 652/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 10:38:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 10:38:17.890748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:17.972205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:17.998181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fadd68-e91e-4b8c-b569-2261c6fa748f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:18.035282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:18.035877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:18.036153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:18.036422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] PATH_INFO: `/v3/services` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:18.037057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] RBAC: Adding query filter params (name=placement) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:38:18.037366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:18.038722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359ad7c-f0cc-4dde-8a9e-acb05675ff4e None admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:18.044149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 653/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 10:38:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:38:18.050230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:38:18.176654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e87a40-cd5a-470c-82b4-2288328cd12d None admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:38:18.214978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a649d08-90c3-4c15-b71e-35c2698b9d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:38:18.215573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a649d08-90c3-4c15-b71e-35c2698b9d62 None admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:38:18.215846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a649d08-90c3-4c15-b71e-35c2698b9d62 None admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:38:18.216118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a649d08-90c3-4c15-b71e-35c2698b9d62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:38:18.216777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a649d08-90c3-4c15-b71e-35c2698b9d62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:38:18.218149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a649d08-90c3-4c15-b71e-35c2698b9d62 None admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:38:18.243049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 653/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:38:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:38:28.041390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=30 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:38:28.238140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:21.531791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949b53d-b75d-4fa6-9a95-64f160803e61 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:21.532345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949b53d-b75d-4fa6-9a95-64f160803e61 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:21.532345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949b53d-b75d-4fa6-9a95-64f160803e61 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:21.533763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 654/1307] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:21.539287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2a6b-bbf3-4bc5-a4c7-448f9d570b8d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:21.540685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2a6b-bbf3-4bc5-a4c7-448f9d570b8d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:21.541106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f2a6b-bbf3-4bc5-a4c7-448f9d570b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:21.619915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-993f2a6b-bbf3-4bc5-a4c7-448f9d570b8d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:21.621233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-993f2a6b-bbf3-4bc5-a4c7-448f9d570b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:21.731238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 654/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:22.020648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d41d-4f86-4305-964b-24619cbddd6a None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:22.021194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d41d-4f86-4305-964b-24619cbddd6a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:22.021522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d41d-4f86-4305-964b-24619cbddd6a None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:22.022909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 655/1309] 10.222.0.26 () {54 vars in 965 bytes} [Fri Aug 12 10:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:22.029097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a8cf-43dd-49aa-9b12-6c6123072f28 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:22.029356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a8cf-43dd-49aa-9b12-6c6123072f28 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:22.029648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058a8cf-43dd-49aa-9b12-6c6123072f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:22.117963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6058a8cf-43dd-49aa-9b12-6c6123072f28 None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:22.119223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6058a8cf-43dd-49aa-9b12-6c6123072f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:22.143851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:22.206442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 655/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Fri Aug 12 10:39:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:22.215506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9d41d-4f86-4305-964b-24619cbddd6a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:22.217459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-03a9d41d-4f86-4305-964b-24619cbddd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:22.341569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9d41d-4f86-4305-964b-24619cbddd6a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:22.419867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:22.420444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:22.420748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:22.420990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:22.422579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:22.481158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:22.542809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:22.544368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37db69-d249-408f-a057-c292a6fbc109 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:22.565415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 656/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:39:24.731330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d583097-4c83-4eec-b2da-2e6fa4b17f43 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:24.731874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d583097-4c83-4eec-b2da-2e6fa4b17f43 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:24.731874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d583097-4c83-4eec-b2da-2e6fa4b17f43 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:24.734467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 656/1312] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:24.738331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fefd3-4e87-4699-a5bc-b9ab04f5ca69 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:24.738876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fefd3-4e87-4699-a5bc-b9ab04f5ca69 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:24.738876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fefd3-4e87-4699-a5bc-b9ab04f5ca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:24.823215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4a1fefd3-4e87-4699-a5bc-b9ab04f5ca69 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:24.824435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4a1fefd3-4e87-4699-a5bc-b9ab04f5ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:24.920301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 657/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:25.197133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d583097-4c83-4eec-b2da-2e6fa4b17f43 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:25.198656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0d583097-4c83-4eec-b2da-2e6fa4b17f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:25.312671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d583097-4c83-4eec-b2da-2e6fa4b17f43 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:25.388700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:25.391954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:25.392573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:25.392854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:25.393191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:25.395951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:25.513607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:25.515022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ce212-5ac2-483a-af5f-b610f131a011 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:25.534070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 657/1314] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:27.745010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0739438-e35e-4621-887b-c423dd763dce None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:27.745607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0739438-e35e-4621-887b-c423dd763dce None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:27.745607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0739438-e35e-4621-887b-c423dd763dce None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:27.746944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 658/1315] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:27.752825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb00c-5c24-4cbd-aec6-34f4ce20e5af None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:27.753364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb00c-5c24-4cbd-aec6-34f4ce20e5af None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:27.753364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fb00c-5c24-4cbd-aec6-34f4ce20e5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:27.821970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e79fb00c-5c24-4cbd-aec6-34f4ce20e5af None None] MFA Rules not processed for user `bd911b6ba3b44b0c99a37ead1cf8511c`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:27.823226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e79fb00c-5c24-4cbd-aec6-34f4ce20e5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:27.880429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:27.931998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 658/1316] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:28.231248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dc847-ba01-403e-85da-9492f660160b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:28.231787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dc847-ba01-403e-85da-9492f660160b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:28.232064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1dc847-ba01-403e-85da-9492f660160b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:28.233441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 659/1317] 10.222.0.26 () {54 vars in 965 bytes} [Fri Aug 12 10:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:28.240345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3c51-4188-479c-ba2f-009a5b08b2ea None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:28.240713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3c51-4188-479c-ba2f-009a5b08b2ea None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:28.241077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c3c51-4188-479c-ba2f-009a5b08b2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:28.327797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-148c3c51-4188-479c-ba2f-009a5b08b2ea None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:28.329007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-148c3c51-4188-479c-ba2f-009a5b08b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:28.408168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 659/1318] 10.222.0.26 () {58 vars in 1062 bytes} [Fri Aug 12 10:39:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:28.417491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dc847-ba01-403e-85da-9492f660160b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:28.419072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bf1dc847-ba01-403e-85da-9492f660160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:28.429062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:28.539790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1dc847-ba01-403e-85da-9492f660160b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:28.614523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:28.615172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:28.615460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:28.615695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:28.617563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:28.680560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:28.730673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:28.732151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cff5a-090d-424d-8747-205fde181895 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:28.750984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 660/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:28 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:31.561081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720125-b516-4c0b-a696-335fca2e6e09 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:31.561941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720125-b516-4c0b-a696-335fca2e6e09 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:31.561941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82720125-b516-4c0b-a696-335fca2e6e09 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:31.564216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 660/1320] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:31.569610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3e09-d36a-46e8-b910-a29fb16208ce None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:31.570068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3e09-d36a-46e8-b910-a29fb16208ce None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:31.570175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b3e09-d36a-46e8-b910-a29fb16208ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:31.638155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-503b3e09-d36a-46e8-b910-a29fb16208ce None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:31.639380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-503b3e09-d36a-46e8-b910-a29fb16208ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:31.737728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 661/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:32.016157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720125-b516-4c0b-a696-335fca2e6e09 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:32.017804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-82720125-b516-4c0b-a696-335fca2e6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:32.070472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:32.130941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82720125-b516-4c0b-a696-335fca2e6e09 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:32.207019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:32.207616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:32.207889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:32.208157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:32.209758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:32.307338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:32.320905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:32.322343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a30e80-c2d0-42f3-8fac-a8e0a0f79aba service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:32.340568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 661/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:34.895173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27eed-66ee-405c-bae1-4b1e7aab7a4c None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:34.895721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27eed-66ee-405c-bae1-4b1e7aab7a4c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:34.895721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d27eed-66ee-405c-bae1-4b1e7aab7a4c None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:34.897143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 662/1323] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:34.902719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9f44-6e94-4c9d-9cc3-7c72b551fd0e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:34.903156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9f44-6e94-4c9d-9cc3-7c72b551fd0e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:34.903256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b9f44-6e94-4c9d-9cc3-7c72b551fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:34.970211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-aa5b9f44-6e94-4c9d-9cc3-7c72b551fd0e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:34.971465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-aa5b9f44-6e94-4c9d-9cc3-7c72b551fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:35.071321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 662/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:35.342337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27eed-66ee-405c-bae1-4b1e7aab7a4c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:35.343963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-33d27eed-66ee-405c-bae1-4b1e7aab7a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:35.364571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:35.453024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d27eed-66ee-405c-bae1-4b1e7aab7a4c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:35.531354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:35.531960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:35.532234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:35.532497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:35.534142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:35.605032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:35.644587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:35.646022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019e7e0-cfc8-4ace-9531-960b255d7fc1 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:35.664877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 663/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:37.599849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1bfc8-d7b3-4d0f-a71a-aaf04ac752f1 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:37.600442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1bfc8-d7b3-4d0f-a71a-aaf04ac752f1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:37.600442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1bfc8-d7b3-4d0f-a71a-aaf04ac752f1 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:37.601641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 663/1326] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:37.606961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174207d-38ed-4f83-8c93-823f01c6d8fc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:37.607426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174207d-38ed-4f83-8c93-823f01c6d8fc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:37.607527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174207d-38ed-4f83-8c93-823f01c6d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:37.677450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5174207d-38ed-4f83-8c93-823f01c6d8fc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:37.678653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5174207d-38ed-4f83-8c93-823f01c6d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:37.777365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 664/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:38.064668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1bfc8-d7b3-4d0f-a71a-aaf04ac752f1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:38.066228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-53a1bfc8-d7b3-4d0f-a71a-aaf04ac752f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:38.132135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:38.182060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1bfc8-d7b3-4d0f-a71a-aaf04ac752f1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:38.258494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:38.259124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:38.259394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:38.259655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:38.261262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:38.379665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:38.382284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:38.383998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08291d6c-dfda-4fef-8375-196c74d7e233 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:38.403578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 664/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:40.304783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c46cd9-1ad5-4ca0-8293-7e6fdfe6361c None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:40.305252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c46cd9-1ad5-4ca0-8293-7e6fdfe6361c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:40.305363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c46cd9-1ad5-4ca0-8293-7e6fdfe6361c None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:40.306710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 665/1329] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:40.312920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071281-4de2-4494-aec1-520fbd342c76 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:40.313360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071281-4de2-4494-aec1-520fbd342c76 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:40.313467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0071281-4de2-4494-aec1-520fbd342c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:40.386604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c0071281-4de2-4494-aec1-520fbd342c76 None None] MFA Rules not processed for user `bd911b6ba3b44b0c99a37ead1cf8511c`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:40.387910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c0071281-4de2-4494-aec1-520fbd342c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:40.490075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 665/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:40.768440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c46cd9-1ad5-4ca0-8293-7e6fdfe6361c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:40.770297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-03c46cd9-1ad5-4ca0-8293-7e6fdfe6361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:40.807085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:40.886596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c46cd9-1ad5-4ca0-8293-7e6fdfe6361c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:40.961052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:40.961658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:40.961934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:40.962205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:40.963856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:41.048643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:41.085806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:41.087768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d677509-1cfc-44d0-8cf1-afa1eeda7dfc service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:41.108474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 666/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:43.259504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e4332-de6e-4a34-aab8-ab15e0a57ae0 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:43.260020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e4332-de6e-4a34-aab8-ab15e0a57ae0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:43.260020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e4332-de6e-4a34-aab8-ab15e0a57ae0 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:43.263247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 666/1332] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:43.270715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5afb3-55c8-4c5f-9b3f-2e3813ff43db None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:43.271188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5afb3-55c8-4c5f-9b3f-2e3813ff43db None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:43.271287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5afb3-55c8-4c5f-9b3f-2e3813ff43db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:43.340220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f6f5afb3-55c8-4c5f-9b3f-2e3813ff43db None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:43.341469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f6f5afb3-55c8-4c5f-9b3f-2e3813ff43db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:43.444874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 667/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:39:43.725688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e4332-de6e-4a34-aab8-ab15e0a57ae0 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:43.728245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d19e4332-de6e-4a34-aab8-ab15e0a57ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:43.810670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:43.847474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e4332-de6e-4a34-aab8-ab15e0a57ae0 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:43.925161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:43.925635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:43.926434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:43.926434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:43.927829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:44.044479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:44.045969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956c286-01fa-4864-8029-84afca592941 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:44.056498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:44.065276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 667/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:45.989707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3b1c-3864-4506-b164-344ff2c1713f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:45.990459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3b1c-3864-4506-b164-344ff2c1713f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:45.990552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3b1c-3864-4506-b164-344ff2c1713f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:45.992707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 668/1335] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:45.998193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dabbe2-cd51-4a31-b22a-e059b0b7fd82 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:45.998635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dabbe2-cd51-4a31-b22a-e059b0b7fd82 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:45.998770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dabbe2-cd51-4a31-b22a-e059b0b7fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:46.066003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-17dabbe2-cd51-4a31-b22a-e059b0b7fd82 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:46.067226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-17dabbe2-cd51-4a31-b22a-e059b0b7fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:46.166629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 668/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:46.447316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3b1c-3864-4506-b164-344ff2c1713f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:46.449730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-18fe3b1c-3864-4506-b164-344ff2c1713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:46.502298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:46.580737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3b1c-3864-4506-b164-344ff2c1713f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:46.657600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:46.658243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:46.658550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:46.658858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:46.660490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:46.749150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:46.776692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:46.778121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224e4b-8503-42ba-b1f4-94580986b637 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:46.796783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 669/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:49.128404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeea64b-194d-43e9-ac54-82222e3b52be None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:49.128931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeea64b-194d-43e9-ac54-82222e3b52be None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:49.128931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeea64b-194d-43e9-ac54-82222e3b52be None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:49.130200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 669/1338] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:49.136570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5ee1-b77a-480b-bbe6-637f46bab6ee None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:49.137007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5ee1-b77a-480b-bbe6-637f46bab6ee None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:49.137117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5ee1-b77a-480b-bbe6-637f46bab6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:49.214214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a37d5ee1-b77a-480b-bbe6-637f46bab6ee None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:49.215450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a37d5ee1-b77a-480b-bbe6-637f46bab6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:49.337864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 670/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:49.620634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeea64b-194d-43e9-ac54-82222e3b52be None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:49.622262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7eeea64b-194d-43e9-ac54-82222e3b52be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:49.699264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:49.727562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeea64b-194d-43e9-ac54-82222e3b52be None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:49.802020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:49.802632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:49.802935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:49.803207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:49.804814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:49.914135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:49.915533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be1e51-2559-4d92-a689-d32481366cda service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:49.933831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 670/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:53.844655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a955d6-b87c-472b-aeca-47715305d8e8 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:53.845079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a955d6-b87c-472b-aeca-47715305d8e8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:53.845277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a955d6-b87c-472b-aeca-47715305d8e8 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:53.846648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 671/1341] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:53.852037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8b46-d6c2-4fbd-a498-babf859fcc92 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:53.852448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8b46-d6c2-4fbd-a498-babf859fcc92 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:53.852569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc8b46-d6c2-4fbd-a498-babf859fcc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:53.858337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:53.922289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-76bc8b46-d6c2-4fbd-a498-babf859fcc92 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:53.923546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-76bc8b46-d6c2-4fbd-a498-babf859fcc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:54.025086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 671/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:54.300875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a955d6-b87c-472b-aeca-47715305d8e8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:54.302503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-21a955d6-b87c-472b-aeca-47715305d8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:54.353447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:54.410592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a955d6-b87c-472b-aeca-47715305d8e8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:54.486477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:54.487111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:54.487385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:54.487648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:54.489261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:54.586571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:54.603617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:54.605055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011467ac-c4c3-4b42-8ce6-b382060cc81e service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:54.624069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 672/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:39:57.167658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ccbe-ba70-45b5-8f7c-da190003332b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:57.168267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ccbe-ba70-45b5-8f7c-da190003332b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:57.168267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ccbe-ba70-45b5-8f7c-da190003332b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:57.169734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 672/1344] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:39:57.175143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c8b9-ca71-4970-a189-1497fa86118c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:57.175590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c8b9-ca71-4970-a189-1497fa86118c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:57.175709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5c8b9-ca71-4970-a189-1497fa86118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:57.245199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-57e5c8b9-ca71-4970-a189-1497fa86118c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:39:57.246402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-57e5c8b9-ca71-4970-a189-1497fa86118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:57.343527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 673/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:39:57.620832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634ccbe-ba70-45b5-8f7c-da190003332b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:39:57.623140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6634ccbe-ba70-45b5-8f7c-da190003332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:57.718017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:39:57.737543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634ccbe-ba70-45b5-8f7c-da190003332b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:39:57.816720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:39:57.817356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:39:57.817634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:39:57.817897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:39:57.819521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:39:57.935077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:39:57.936551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3cb4f-b839-4f45-b5a6-a9529730eabe service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:39:57.957195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 673/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:01.803969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83660e-93c0-4e57-80f8-81559a5f9d28 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:01.804538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83660e-93c0-4e57-80f8-81559a5f9d28 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:01.804538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83660e-93c0-4e57-80f8-81559a5f9d28 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:01.806012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 674/1347] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:01.811412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbaa24-561c-4709-914c-a7be5fc24180 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:01.811891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbaa24-561c-4709-914c-a7be5fc24180 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:01.811969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbaa24-561c-4709-914c-a7be5fc24180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:01.828137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:01.883299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-30bbaa24-561c-4709-914c-a7be5fc24180 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:01.884551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-30bbaa24-561c-4709-914c-a7be5fc24180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:01.995099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 674/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:02.275897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83660e-93c0-4e57-80f8-81559a5f9d28 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:02.277375 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0b83660e-93c0-4e57-80f8-81559a5f9d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:02.341215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:02.392345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b83660e-93c0-4e57-80f8-81559a5f9d28 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:02.471477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:02.472037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:02.472310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:02.472577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:02.474173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:02.587827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:02.592351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:02.594177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e484f3-1d2f-49ee-90d1-ed04b13ff7cd service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:02.615844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 675/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:07.451481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b7fd-f527-4b19-b2a5-db536f3a4e2f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:07.451972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b7fd-f527-4b19-b2a5-db536f3a4e2f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:07.452061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12b7fd-f527-4b19-b2a5-db536f3a4e2f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:07.453385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 675/1350] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:07.458810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74e74f-8197-455e-be68-2c51df16fe05 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:07.459248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74e74f-8197-455e-be68-2c51df16fe05 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:07.459335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74e74f-8197-455e-be68-2c51df16fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:07.552930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4a74e74f-8197-455e-be68-2c51df16fe05 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:07.554530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4a74e74f-8197-455e-be68-2c51df16fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:07.714700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 676/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:40:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:11.947732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf52f89-d2e8-4738-bf23-7cbf938f406f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:11.948320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf52f89-d2e8-4738-bf23-7cbf938f406f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:11.948320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf52f89-d2e8-4738-bf23-7cbf938f406f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:11.949768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 676/1352] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:11.954661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c181-215c-405c-88aa-cf1f2218378e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:11.955534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c181-215c-405c-88aa-cf1f2218378e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:11.956029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55c181-215c-405c-88aa-cf1f2218378e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:11.988133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=59 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:12.179612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:12.206615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2c55c181-215c-405c-88aa-cf1f2218378e None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:12.207766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2c55c181-215c-405c-88aa-cf1f2218378e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:12.319317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 677/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:40:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:13.386271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cae649-ebb5-459d-a280-9b9443180b9b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:13.386846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cae649-ebb5-459d-a280-9b9443180b9b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:13.386846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cae649-ebb5-459d-a280-9b9443180b9b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:13.388321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 677/1354] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:13.393187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bcafb-f9e8-4ccc-8c32-709ed20f9e76 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:13.393612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bcafb-f9e8-4ccc-8c32-709ed20f9e76 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:13.393923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bcafb-f9e8-4ccc-8c32-709ed20f9e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:13.480670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-462bcafb-f9e8-4ccc-8c32-709ed20f9e76 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:13.481877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-462bcafb-f9e8-4ccc-8c32-709ed20f9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:13.524831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:13.589847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 678/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:16.794037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b156a9-a681-4cc1-ba3d-d97900e972ff None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:16.794605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b156a9-a681-4cc1-ba3d-d97900e972ff None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:16.794605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b156a9-a681-4cc1-ba3d-d97900e972ff None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:16.795925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 678/1356] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:16.801232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37452-065e-4878-bf2f-b8718077df1b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:16.801653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37452-065e-4878-bf2f-b8718077df1b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:16.801759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc37452-065e-4878-bf2f-b8718077df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:16.881517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8fc37452-065e-4878-bf2f-b8718077df1b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:16.882836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8fc37452-065e-4878-bf2f-b8718077df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:17.010477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 679/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:17.307533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050025b7-8fb9-43ff-bfde-df23234b9f5d None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:17.307957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050025b7-8fb9-43ff-bfde-df23234b9f5d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:17.308413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050025b7-8fb9-43ff-bfde-df23234b9f5d None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:17.310710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 679/1358] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 10:40:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:17.323955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4920bd-37a5-4b27-8c4e-7e2d304dd5d9 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:17.324261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4920bd-37a5-4b27-8c4e-7e2d304dd5d9 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:17.324514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4920bd-37a5-4b27-8c4e-7e2d304dd5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:17.343149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:17.409368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3f4920bd-37a5-4b27-8c4e-7e2d304dd5d9 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:17.410614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3f4920bd-37a5-4b27-8c4e-7e2d304dd5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:17.535963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 680/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 10:40:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:17.543764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050025b7-8fb9-43ff-bfde-df23234b9f5d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:17.545390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-050025b7-8fb9-43ff-bfde-df23234b9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:17.700216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050025b7-8fb9-43ff-bfde-df23234b9f5d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:17.791524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:17.832416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:17.833225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:17.833639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:17.833896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:17.835857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:17.928743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:17.930508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf1f7d-db89-4c39-b1d3-f2e3e0e3e6d0 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:17.950537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 680/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:20.052343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762645fd-000d-4778-99a1-852f900c8590 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:20.052787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762645fd-000d-4778-99a1-852f900c8590 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:20.052897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762645fd-000d-4778-99a1-852f900c8590 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:20.054401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 681/1361] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:20.060157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18411-14d4-43de-b150-28c694085fd3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:20.060634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18411-14d4-43de-b150-28c694085fd3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:20.060724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18411-14d4-43de-b150-28c694085fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:20.129298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f6c18411-14d4-43de-b150-28c694085fd3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:20.130420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f6c18411-14d4-43de-b150-28c694085fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:20.171352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:20.238639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 681/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:20.527796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762645fd-000d-4778-99a1-852f900c8590 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:20.531262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-762645fd-000d-4778-99a1-852f900c8590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:20.620813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:20.716551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762645fd-000d-4778-99a1-852f900c8590 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:20.841437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296f885-8874-463b-9048-ff575754a62c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:20.842050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f885-8874-463b-9048-ff575754a62c service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:20.842313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f885-8874-463b-9048-ff575754a62c service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:20.842598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296f885-8874-463b-9048-ff575754a62c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:20.844239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9296f885-8874-463b-9048-ff575754a62c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:20.868323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:20.947534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f885-8874-463b-9048-ff575754a62c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:20.949228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296f885-8874-463b-9048-ff575754a62c service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:20.972234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 682/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:23.179822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d49f26-6b4f-454a-ab7e-faea24fd6605 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:23.180863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d49f26-6b4f-454a-ab7e-faea24fd6605 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:23.181410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d49f26-6b4f-454a-ab7e-faea24fd6605 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:23.187466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 682/1364] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:23.189295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931870c-dd6f-444c-b2d8-1b25bf6ee82b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:23.189727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931870c-dd6f-444c-b2d8-1b25bf6ee82b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:23.189877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931870c-dd6f-444c-b2d8-1b25bf6ee82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:23.280391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5931870c-dd6f-444c-b2d8-1b25bf6ee82b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:23.281605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5931870c-dd6f-444c-b2d8-1b25bf6ee82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:23.386985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:23.395211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 683/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:23.676170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf7a7-93e6-43a7-850b-40c26dca6e21 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:23.676418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf7a7-93e6-43a7-850b-40c26dca6e21 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:23.676922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf7a7-93e6-43a7-850b-40c26dca6e21 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:23.678437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 683/1366] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 10:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:23.684384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e15956-214c-44ae-827c-797a9d3b42bc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:23.684736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e15956-214c-44ae-827c-797a9d3b42bc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:23.685056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e15956-214c-44ae-827c-797a9d3b42bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:23.765668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-91e15956-214c-44ae-827c-797a9d3b42bc None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:23.766914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-91e15956-214c-44ae-827c-797a9d3b42bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:23.895123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 684/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 10:40:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:23.903210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf7a7-93e6-43a7-850b-40c26dca6e21 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:23.904745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d14cf7a7-93e6-43a7-850b-40c26dca6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:24.067436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf7a7-93e6-43a7-850b-40c26dca6e21 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:24.090458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:24.187964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:24.188653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:24.189005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:24.189142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:24.190845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:24.285462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:24.287593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240fc909-3370-470e-800f-7df0b5f78166 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:24.308174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 684/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:24.884420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0850e4-309d-4778-9e0e-bc5075b49d55 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:24.885004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0850e4-309d-4778-9e0e-bc5075b49d55 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:24.885004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0850e4-309d-4778-9e0e-bc5075b49d55 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:24.886456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 685/1369] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:40:24.891579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5ac9a-eabd-4057-a737-5ecbe5282915 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:24.891821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5ac9a-eabd-4057-a737-5ecbe5282915 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:24.892160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5ac9a-eabd-4057-a737-5ecbe5282915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:24.925275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:24.961370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-81a5ac9a-eabd-4057-a737-5ecbe5282915 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:24.962559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-81a5ac9a-eabd-4057-a737-5ecbe5282915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:25.067416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 685/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:25.646154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16075-e77a-4052-8420-0961e0e84936 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:25.646434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16075-e77a-4052-8420-0961e0e84936 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:25.646727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16075-e77a-4052-8420-0961e0e84936 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:25.648220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 686/1371] 10.222.0.26 () {54 vars in 964 bytes} [Fri Aug 12 10:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:25.653191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8ab6-e741-4d34-8f51-d6057de26c39 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:25.653668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8ab6-e741-4d34-8f51-d6057de26c39 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:25.653668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8ab6-e741-4d34-8f51-d6057de26c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:25.730945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-bd8b8ab6-e741-4d34-8f51-d6057de26c39 None None] MFA Rules not processed for user `044f1d33d9be4cdc827237fae316db0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:25.732141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bd8b8ab6-e741-4d34-8f51-d6057de26c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:25.779518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:25.810115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 686/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Aug 12 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:25.818137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16075-e77a-4052-8420-0961e0e84936 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:25.820098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5ec16075-e77a-4052-8420-0961e0e84936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:25.875810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:25.937199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16075-e77a-4052-8420-0961e0e84936 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:26.012594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:26.013225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:26.013497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:26.013760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:26.015382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:26.117056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:26.132912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:26.134397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef8fe-a9b1-45bc-9dc4-eac2f3eba5da service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:26.153757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 687/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:26.260419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa052f-4322-49af-b356-05978be128b2 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:26.260955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa052f-4322-49af-b356-05978be128b2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:26.260955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa052f-4322-49af-b356-05978be128b2 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:26.262661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 687/1374] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:26.269977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f223-c353-4cff-8313-2a594dbbd3e8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:26.270258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f223-c353-4cff-8313-2a594dbbd3e8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:26.270529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f223-c353-4cff-8313-2a594dbbd3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:26.337680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3883f223-c353-4cff-8313-2a594dbbd3e8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:26.338511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3883f223-c353-4cff-8313-2a594dbbd3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:26.452549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 688/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:26.735055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa052f-4322-49af-b356-05978be128b2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:26.736808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-67aa052f-4322-49af-b356-05978be128b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:26.887958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa052f-4322-49af-b356-05978be128b2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:26.938946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:27.003174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:27.003791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:27.004061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:27.004328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:27.005931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:27.093179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:27.094813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5abb77-8251-498c-93cb-67b5ce1faec4 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:27.112583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 688/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:29.026476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030241-7a9f-43ab-8ce9-4379d0493d11 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:29.027051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030241-7a9f-43ab-8ce9-4379d0493d11 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:29.027051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030241-7a9f-43ab-8ce9-4379d0493d11 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:29.028376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 689/1377] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:29.033785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0619d5c-55de-44df-a687-c36d972c7f6a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:29.034219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0619d5c-55de-44df-a687-c36d972c7f6a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:29.034456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0619d5c-55de-44df-a687-c36d972c7f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:29.112489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f0619d5c-55de-44df-a687-c36d972c7f6a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:29.113687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f0619d5c-55de-44df-a687-c36d972c7f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:29.131714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:29.238123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 689/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:29.524744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030241-7a9f-43ab-8ce9-4379d0493d11 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:29.526271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cc030241-7a9f-43ab-8ce9-4379d0493d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:29.618332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:29.728579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030241-7a9f-43ab-8ce9-4379d0493d11 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:29.850050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:29.850649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:29.850955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:29.851219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:29.852826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:29.872201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:29.948043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:29.949614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a1751-e33a-4104-90bc-9efd789b5d1a service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:29.971534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 690/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:31.889009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d06a-7d05-41ce-99dc-5593d5ad3c48 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:31.889475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d06a-7d05-41ce-99dc-5593d5ad3c48 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:31.889628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479d06a-7d05-41ce-99dc-5593d5ad3c48 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:31.891098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 690/1380] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:31.896701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dc64-8fd8-4b33-abe2-7a0a048bed69 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:31.897178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dc64-8fd8-4b33-abe2-7a0a048bed69 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:31.897274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665dc64-8fd8-4b33-abe2-7a0a048bed69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:31.979135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4665dc64-8fd8-4b33-abe2-7a0a048bed69 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:31.980351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4665dc64-8fd8-4b33-abe2-7a0a048bed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:32.095475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:32.103117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 691/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:40:32.384398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d06a-7d05-41ce-99dc-5593d5ad3c48 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:32.385928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4479d06a-7d05-41ce-99dc-5593d5ad3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:32.543433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:32.555932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479d06a-7d05-41ce-99dc-5593d5ad3c48 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:32.682441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:32.682975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:32.683252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:32.683523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:32.685181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:32.777007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:32.778854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0906ff-0542-4510-83ac-5932dabe8512 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:32.789995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:32.800124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 691/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:34.999652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b0a50-cb3f-4ba5-aa1e-d56ed225c068 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:35.000135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b0a50-cb3f-4ba5-aa1e-d56ed225c068 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:35.000232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b0a50-cb3f-4ba5-aa1e-d56ed225c068 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:35.001563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 692/1383] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:35.007732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e82b8-1516-4c29-8fdc-d11de1dc179d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:35.008210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e82b8-1516-4c29-8fdc-d11de1dc179d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:35.008325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e82b8-1516-4c29-8fdc-d11de1dc179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:35.081328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-cf6e82b8-1516-4c29-8fdc-d11de1dc179d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:35.082954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cf6e82b8-1516-4c29-8fdc-d11de1dc179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:35.191365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 692/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:35.473107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b0a50-cb3f-4ba5-aa1e-d56ed225c068 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:35.474781 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-877b0a50-cb3f-4ba5-aa1e-d56ed225c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:35.633128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b0a50-cb3f-4ba5-aa1e-d56ed225c068 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:35.708183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:35.758455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:35.758947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:35.759223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:35.759497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:35.761177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:35.852218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:35.853869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e52d8-95ed-4614-a107-176f6495ab0b service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:35.873384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 693/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:37.797286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5de1f0-a16a-4e45-906b-8a6fbb992296 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:37.797882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5de1f0-a16a-4e45-906b-8a6fbb992296 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:37.797882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5de1f0-a16a-4e45-906b-8a6fbb992296 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:37.799325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 693/1386] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:37.805753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11465030-5319-4358-9002-bb41e725a32f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:37.806255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11465030-5319-4358-9002-bb41e725a32f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:37.806367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11465030-5319-4358-9002-bb41e725a32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:37.874179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-11465030-5319-4358-9002-bb41e725a32f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:37.875512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-11465030-5319-4358-9002-bb41e725a32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:37.909139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:37.980585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 694/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:38.345771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5de1f0-a16a-4e45-906b-8a6fbb992296 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:38.347455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6d5de1f0-a16a-4e45-906b-8a6fbb992296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:38.432590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:38.511219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5de1f0-a16a-4e45-906b-8a6fbb992296 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:38.648354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:38.649090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:38.649441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:38.649781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:38.651868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:38.698524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:38.750586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:38.752303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad80a7-b261-4ad0-9185-e08a3f411fec service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:38.770650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 694/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:40.723524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9117-4fc7-4373-84ab-a8d8b9403bcc None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:40.724155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9117-4fc7-4373-84ab-a8d8b9403bcc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:40.724155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b9117-4fc7-4373-84ab-a8d8b9403bcc None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:40.725573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 695/1389] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:40.730697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c43b3-758e-4144-97ff-5f75edb56238 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:40.731181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c43b3-758e-4144-97ff-5f75edb56238 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:40.731269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c43b3-758e-4144-97ff-5f75edb56238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:40.798411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9b0c43b3-758e-4144-97ff-5f75edb56238 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:40.799718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9b0c43b3-758e-4144-97ff-5f75edb56238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:40.898767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 695/1390] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:41.178738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9117-4fc7-4373-84ab-a8d8b9403bcc None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:41.180338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a65b9117-4fc7-4373-84ab-a8d8b9403bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:41.185010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2afb1-0530-49d3-a788-cac5de3dcb50 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:41.185317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2afb1-0530-49d3-a788-cac5de3dcb50 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:41.185615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2afb1-0530-49d3-a788-cac5de3dcb50 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:41.187328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 696/1391] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:40:41.192462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b3d71-0430-4cf7-b54a-8c9e76b5bdc2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:41.192767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b3d71-0430-4cf7-b54a-8c9e76b5bdc2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:41.193064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b3d71-0430-4cf7-b54a-8c9e76b5bdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:41.209597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:41.260819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-363b3d71-0430-4cf7-b54a-8c9e76b5bdc2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:41.261940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-363b3d71-0430-4cf7-b54a-8c9e76b5bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:41.335020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b9117-4fc7-4373-84ab-a8d8b9403bcc None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:41.352690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:41.356231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 697/1392] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:40:41.457723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:41.458341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:41.458589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:41.458884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:41.460498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:41.557906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:41.559630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fe1f1-26a6-4ff4-8339-23a6e54e14a6 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:41.579157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 696/1393] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:41.656790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928237-854a-4545-a49a-d8e0b1d78a23 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:41.657045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928237-854a-4545-a49a-d8e0b1d78a23 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:41.657348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928237-854a-4545-a49a-d8e0b1d78a23 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:41.658852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 698/1394] 10.222.0.26 () {54 vars in 967 bytes} [Fri Aug 12 10:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:41.664838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277031-abbe-4b35-aeca-2c75533018f0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:41.665174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277031-abbe-4b35-aeca-2c75533018f0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:41.665390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9277031-abbe-4b35-aeca-2c75533018f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:41.694521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:41.752257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d9277031-abbe-4b35-aeca-2c75533018f0 None None] MFA Rules not processed for user `b37e24a9e7d74e1ca95f6061beeb9343`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:41.753573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d9277031-abbe-4b35-aeca-2c75533018f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:41.833900 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 697/1395] 10.222.0.26 () {58 vars in 1064 bytes} [Fri Aug 12 10:40:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:41.841540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928237-854a-4545-a49a-d8e0b1d78a23 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:41.843103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-35928237-854a-4545-a49a-d8e0b1d78a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:41.942663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:41.951066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928237-854a-4545-a49a-d8e0b1d78a23 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:42.032812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:42.033483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:42.033758 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:42.034023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:42.035670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:42.147158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:42.148506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd2da6-6ad6-454f-8ee1-4f592297af89 service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:42.166917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 699/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:42.901891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f03dcb-bd98-4e33-acf6-6b5d19a17c2f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:42.902369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f03dcb-bd98-4e33-acf6-6b5d19a17c2f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:42.902463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f03dcb-bd98-4e33-acf6-6b5d19a17c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:42.973004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-89f03dcb-bd98-4e33-acf6-6b5d19a17c2f None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:42.974204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-89f03dcb-bd98-4e33-acf6-6b5d19a17c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:43.035921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:43.064779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 698/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:40:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:40:43.109933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b56a7-7461-41e0-9df4-0ec058286985 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:43.110411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b56a7-7461-41e0-9df4-0ec058286985 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:43.110600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b56a7-7461-41e0-9df4-0ec058286985 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:43.112117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 700/1398] 10.222.0.26 () {54 vars in 943 bytes} [Fri Aug 12 10:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:43.118570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f1b1d-3d58-4b94-a379-2782fc2b2439 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:43.118882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f1b1d-3d58-4b94-a379-2782fc2b2439 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:43.119152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f1b1d-3d58-4b94-a379-2782fc2b2439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:43.200126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-be6f1b1d-3d58-4b94-a379-2782fc2b2439 None None] MFA Rules not processed for user `c4434ebd2f9c42abaf5f1191681c9989`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:43.201354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-be6f1b1d-3d58-4b94-a379-2782fc2b2439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:43.319233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 699/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Fri Aug 12 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:43.329241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b56a7-7461-41e0-9df4-0ec058286985 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:43.330858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a97b56a7-7461-41e0-9df4-0ec058286985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:43.358508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:43.484323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b56a7-7461-41e0-9df4-0ec058286985 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:43.521136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e5c06-5f83-48ad-809a-3459967ec687 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:43.521422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e5c06-5f83-48ad-809a-3459967ec687 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:43.521698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e5c06-5f83-48ad-809a-3459967ec687 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:43.523229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 700/1400] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:40:43.528604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4e1d3-c1cb-4d00-9236-75e4b1c5d946 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:43.528604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4e1d3-c1cb-4d00-9236-75e4b1c5d946 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:43.528604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd4e1d3-c1cb-4d00-9236-75e4b1c5d946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:43.575428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:43.597840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7bd4e1d3-c1cb-4d00-9236-75e4b1c5d946 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:43.598397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:43.599034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:43.599135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7bd4e1d3-c1cb-4d00-9236-75e4b1c5d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:43.599315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:43.599603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:43.601233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:43.608382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:43.684307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:43.685806 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:43.693813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 701/1401] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:40:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:40:43.704649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 701/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:40:43.987312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:43.987637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:44.097848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab19ec-5a90-4769-9f24-ac8780550706 service swift] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:44.157619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:44.228171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:44.228694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:44.228972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:44.229242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:44.230905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:44.331946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:44.333844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76322673-d952-40dd-923b-ff973cdda0c7 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:44.352675 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 702/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:46.285735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef58e-2bf1-4934-9261-bf0b72c56e3a None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:46.286258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef58e-2bf1-4934-9261-bf0b72c56e3a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:46.286258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ef58e-2bf1-4934-9261-bf0b72c56e3a None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:46.287578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 702/1404] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:46.293285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b212c-f7fe-447c-be90-165f1c87ad7c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:46.293745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b212c-f7fe-447c-be90-165f1c87ad7c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:46.293745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b212c-f7fe-447c-be90-165f1c87ad7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:46.371691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2a5b212c-f7fe-447c-be90-165f1c87ad7c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:46.372903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2a5b212c-f7fe-447c-be90-165f1c87ad7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:46.388336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:46.487364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 703/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:40:46.787175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef58e-2bf1-4934-9261-bf0b72c56e3a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:46.788721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7e5ef58e-2bf1-4934-9261-bf0b72c56e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:46.913701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:46.956394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ef58e-2bf1-4934-9261-bf0b72c56e3a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:47.080756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:47.081403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:47.081684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:47.081982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:47.083639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:47.177895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:47.195387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:47.197078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526b96-3398-49a2-a13d-9b885a1b951c service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:47.217706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 703/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:49.205818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f90d5-5dd5-41cf-8e2d-a2a5026879f7 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:49.206373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f90d5-5dd5-41cf-8e2d-a2a5026879f7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:49.206373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f90d5-5dd5-41cf-8e2d-a2a5026879f7 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:49.212534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 704/1407] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:40:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:40:49.213630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c761-efcc-4ace-a79d-4ae0f38af061 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:49.214094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c761-efcc-4ace-a79d-4ae0f38af061 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:49.214282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4c761-efcc-4ace-a79d-4ae0f38af061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:49.288468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1da4c761-efcc-4ace-a79d-4ae0f38af061 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:40:49.289694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1da4c761-efcc-4ace-a79d-4ae0f38af061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:49.402982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 704/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:40:49.711066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f90d5-5dd5-41cf-8e2d-a2a5026879f7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:40:49.712610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-dd8f90d5-5dd5-41cf-8e2d-a2a5026879f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:49.880175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:40:49.883566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8f90d5-5dd5-41cf-8e2d-a2a5026879f7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:40:50.016088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:40:50.016735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:40:50.017025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:40:50.017289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:40:50.019146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:40:50.122254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:40:50.124032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c84d0d-3e42-4bf1-a723-aa1d17d05765 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:40:50.146237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 705/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:40:59.401016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=76 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:00.143424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:05.259804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a264-9313-497e-943e-240b9ffcaa9a None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:05.260357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a264-9313-497e-943e-240b9ffcaa9a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:05.260357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4a264-9313-497e-943e-240b9ffcaa9a None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:05.261590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 705/1410] 10.222.0.26 () {54 vars in 918 bytes} [Fri Aug 12 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:05.267124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1930-6aee-485a-b3bf-f14e2458f736 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:05.267576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1930-6aee-485a-b3bf-f14e2458f736 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:05.267668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f1930-6aee-485a-b3bf-f14e2458f736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:05.347012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d60f1930-6aee-485a-b3bf-f14e2458f736 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:05.348243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d60f1930-6aee-485a-b3bf-f14e2458f736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:05.461974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 706/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Aug 12 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:05.477864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47149-b168-47d4-a44f-71a99278b366 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:05.478146 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47149-b168-47d4-a44f-71a99278b366 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:05.478414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47149-b168-47d4-a44f-71a99278b366 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:05.479838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 706/1412] 10.222.0.26 () {54 vars in 918 bytes} [Fri Aug 12 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:05.485491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9e6a1-82b7-469c-91c0-ecb80bdedc7e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:05.485817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9e6a1-82b7-469c-91c0-ecb80bdedc7e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:05.486249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9e6a1-82b7-469c-91c0-ecb80bdedc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:05.559639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:05.563016 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0eb9e6a1-82b7-469c-91c0-ecb80bdedc7e None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:05.564781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0eb9e6a1-82b7-469c-91c0-ecb80bdedc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:05.685886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 707/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Aug 12 10:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:08.031516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24de56-47d8-46e0-b8f3-d555b82a2d11 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:08.032023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24de56-47d8-46e0-b8f3-d555b82a2d11 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:08.032023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24de56-47d8-46e0-b8f3-d555b82a2d11 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:08.033475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:08.038704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d0d2e-76b8-4d8f-9c39-5299a294fd93 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:08.039154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d0d2e-76b8-4d8f-9c39-5299a294fd93 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:08.039255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d0d2e-76b8-4d8f-9c39-5299a294fd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:08.113844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-913d0d2e-76b8-4d8f-9c39-5299a294fd93 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:08.115709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-913d0d2e-76b8-4d8f-9c39-5299a294fd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:08.178958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:08.227283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:08.511206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24de56-47d8-46e0-b8f3-d555b82a2d11 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:08.513613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1b24de56-47d8-46e0-b8f3-d555b82a2d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:08.670637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24de56-47d8-46e0-b8f3-d555b82a2d11 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:08.747618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:08.789836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:08.790436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:08.790725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:08.791006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:08.792619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:08.885511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:08.887171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f0354-36a2-4c63-ba27-19a2472a2760 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:08.905797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 708/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:09.800268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99f75-807a-4abb-9535-0139c68910a0 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:09.800862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99f75-807a-4abb-9535-0139c68910a0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:09.800862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d99f75-807a-4abb-9535-0139c68910a0 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:09.802126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:09.808226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dfe48-c3b2-4e9f-b482-481bffd5f2e8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:09.808962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dfe48-c3b2-4e9f-b482-481bffd5f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:09.809087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dfe48-c3b2-4e9f-b482-481bffd5f2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:09.890265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-493dfe48-c3b2-4e9f-b482-481bffd5f2e8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:09.891508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-493dfe48-c3b2-4e9f-b482-481bffd5f2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:09.919975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:09.994510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:10.154881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99f75-807a-4abb-9535-0139c68910a0 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:10.157180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-77d99f75-807a-4abb-9535-0139c68910a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:10.315832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d99f75-807a-4abb-9535-0139c68910a0 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:10.360109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:10.442861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:10.443378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:10.443655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:10.443914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:10.445547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:10.539295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:10.540885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1517e2-2e9d-4482-9b6e-9df883e696eb service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:10.559229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 710/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:11.447627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248ced8-fe46-420f-a1ae-34149481295f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:11.448233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248ced8-fe46-420f-a1ae-34149481295f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:11.448330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248ced8-fe46-420f-a1ae-34149481295f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:11.450008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:11.456537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8697-15a5-45cc-be2c-8efbb60d52ab None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:11.457277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8697-15a5-45cc-be2c-8efbb60d52ab None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:11.457577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed8697-15a5-45cc-be2c-8efbb60d52ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:11.529919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:11.556664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-70ed8697-15a5-45cc-be2c-8efbb60d52ab None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:11.558528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-70ed8697-15a5-45cc-be2c-8efbb60d52ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:11.662423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:11.819425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248ced8-fe46-420f-a1ae-34149481295f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:11.820979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7248ced8-fe46-420f-a1ae-34149481295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:11.976485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248ced8-fe46-420f-a1ae-34149481295f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:11.989648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:12.093290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:12.093808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:12.094086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:12.094353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:12.096103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:12.192525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:12.194128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96c610-7dbf-4ad0-af96-cb881ef7cf84 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:12.212633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 711/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:13.087785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb716-b771-42cb-bf07-d20d2f798b90 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:13.088648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb716-b771-42cb-bf07-d20d2f798b90 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:13.088821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfbb716-b771-42cb-bf07-d20d2f798b90 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:13.090938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:13.099309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724f1e5-b3ed-4cad-a735-e38b53ea1cf4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:13.099748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724f1e5-b3ed-4cad-a735-e38b53ea1cf4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:13.100008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724f1e5-b3ed-4cad-a735-e38b53ea1cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:13.124349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:13.187231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5724f1e5-b3ed-4cad-a735-e38b53ea1cf4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:13.188431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5724f1e5-b3ed-4cad-a735-e38b53ea1cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:13.289293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:13.440353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbb716-b771-42cb-bf07-d20d2f798b90 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:13.441814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8dfbb716-b771-42cb-bf07-d20d2f798b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:13.557390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:13.596633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfbb716-b771-42cb-bf07-d20d2f798b90 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:13.720406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:13.720927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:13.721202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:13.721439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:13.723115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:13.811188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:13.827717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:13.829427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579b50e-06d5-484a-b173-bc5c31826f2d service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:13.849833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 713/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:14.728257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80727-d825-4e80-89f8-6ebd51b49de0 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:14.728870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80727-d825-4e80-89f8-6ebd51b49de0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:14.728870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca80727-d825-4e80-89f8-6ebd51b49de0 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:14.730173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:14.735304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcef00-67ff-4cd0-ab45-d3bd58b0be40 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:14.735781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcef00-67ff-4cd0-ab45-d3bd58b0be40 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:14.735902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcef00-67ff-4cd0-ab45-d3bd58b0be40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:14.817723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e0bcef00-67ff-4cd0-ab45-d3bd58b0be40 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:14.818967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e0bcef00-67ff-4cd0-ab45-d3bd58b0be40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:14.924882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:15.081260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80727-d825-4e80-89f8-6ebd51b49de0 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:15.083710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8ca80727-d825-4e80-89f8-6ebd51b49de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:15.180655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:15.246157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca80727-d825-4e80-89f8-6ebd51b49de0 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:15.369880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:15.370491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:15.370775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:15.371043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:15.372659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:15.424757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:15.478092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:15.480439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd717a84-5ca4-4283-8c62-5f1db1cc9417 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:15.501481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 714/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:16.291955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b0fd-f569-4b55-80ba-39b51c92c675 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:16.292740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b0fd-f569-4b55-80ba-39b51c92c675 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:16.292740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b0fd-f569-4b55-80ba-39b51c92c675 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:16.294966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:16.300960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534049-a12b-4a2b-8248-2cbe43073e47 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:16.301671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534049-a12b-4a2b-8248-2cbe43073e47 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:16.301816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8534049-a12b-4a2b-8248-2cbe43073e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:16.387560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b8534049-a12b-4a2b-8248-2cbe43073e47 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:16.388776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b8534049-a12b-4a2b-8248-2cbe43073e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:16.501528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:16.661162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0b0fd-f569-4b55-80ba-39b51c92c675 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:16.662636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-43f0b0fd-f569-4b55-80ba-39b51c92c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:16.722256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:16.825496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0b0fd-f569-4b55-80ba-39b51c92c675 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:16.943049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:16.943613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:16.943885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:16.944147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:16.945746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:16.952730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:17.038988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:17.040588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88d2d7-80b8-43c4-9d31-ab937064745e service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:17.059804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 716/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:17.885099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9c0e-60e4-44be-95c2-7a09f3968966 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:17.885724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9c0e-60e4-44be-95c2-7a09f3968966 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:17.885724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f9c0e-60e4-44be-95c2-7a09f3968966 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:17.887715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:17.893596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aba72-3297-4df3-9329-e984dfaf4b98 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:17.894058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aba72-3297-4df3-9329-e984dfaf4b98 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:17.894159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aba72-3297-4df3-9329-e984dfaf4b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:17.977623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-fc7aba72-3297-4df3-9329-e984dfaf4b98 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:17.978894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fc7aba72-3297-4df3-9329-e984dfaf4b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:18.051901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:18.085419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:18.233505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f9c0e-60e4-44be-95c2-7a09f3968966 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:18.236332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-629f9c0e-60e4-44be-95c2-7a09f3968966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:18.263533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:18.399339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f9c0e-60e4-44be-95c2-7a09f3968966 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:18.492580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:18.519904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:18.520513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:18.520789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:18.521058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:18.522672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:18.622156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:18.623831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a27e663-0316-4e85-a68b-1fdefa2e635c service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:18.645420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 717/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:19.458043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773d63-59a0-4540-91ee-b56f0f94039e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:19.459030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773d63-59a0-4540-91ee-b56f0f94039e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:19.459030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1773d63-59a0-4540-91ee-b56f0f94039e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:19.461001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:19.469101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191e7e-56f4-4b7d-bc7b-fc14df56842b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:19.469536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191e7e-56f4-4b7d-bc7b-fc14df56842b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:19.469689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191e7e-56f4-4b7d-bc7b-fc14df56842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:19.547545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-11191e7e-56f4-4b7d-bc7b-fc14df56842b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:19.548791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-11191e7e-56f4-4b7d-bc7b-fc14df56842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:19.596050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:19.658148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:19.812670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1773d63-59a0-4540-91ee-b56f0f94039e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:19.815182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d1773d63-59a0-4540-91ee-b56f0f94039e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:19.989179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1773d63-59a0-4540-91ee-b56f0f94039e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:20.043187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:20.107913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:20.108456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:20.108728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:20.108988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:20.110869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:20.206041 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:20.207692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2c9e0-f0ab-4754-a3ee-7c0b2bc3c4bc service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:20.226441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 719/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:21.030026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f289d-5a9f-45c5-8990-eaf1395c9345 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:21.030535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f289d-5a9f-45c5-8990-eaf1395c9345 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:21.030640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f289d-5a9f-45c5-8990-eaf1395c9345 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:21.032733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:41:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:21.040486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970116b-8c23-4fab-ae5f-d4c5113e0bcf None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:21.040939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970116b-8c23-4fab-ae5f-d4c5113e0bcf None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:21.041077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970116b-8c23-4fab-ae5f-d4c5113e0bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:21.127192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7970116b-8c23-4fab-ae5f-d4c5113e0bcf None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:21.128327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7970116b-8c23-4fab-ae5f-d4c5113e0bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:21.130330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:21.227391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:21.380707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f289d-5a9f-45c5-8990-eaf1395c9345 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:21.383137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f49f289d-5a9f-45c5-8990-eaf1395c9345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:21.552376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f289d-5a9f-45c5-8990-eaf1395c9345 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:21.579339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:21.669989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:21.670513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:21.670823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:21.671095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:21.672790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:21.771041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:21.772641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88ba04-f3d1-4839-8768-2d06e1899665 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:21.791269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 720/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:23.575605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d494-db01-46b3-9315-65d896d244a9 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:23.576478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d494-db01-46b3-9315-65d896d244a9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:23.576478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401d494-db01-46b3-9315-65d896d244a9 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:23.578719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:23.584454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df470-e229-4edd-85a1-349772722b52 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:23.584923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df470-e229-4edd-85a1-349772722b52 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:23.585026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df470-e229-4edd-85a1-349772722b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:23.630774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:23.657924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cf3df470-e229-4edd-85a1-349772722b52 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:23.659177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cf3df470-e229-4edd-85a1-349772722b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:23.758322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:41:24.038903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d494-db01-46b3-9315-65d896d244a9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:24.041027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9401d494-db01-46b3-9315-65d896d244a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:24.287606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401d494-db01-46b3-9315-65d896d244a9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:24.323716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:24.369414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:24.370271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:24.370626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:24.370980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:24.373531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:24.494412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:24.495936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39f2d-4aea-4fda-b0eb-93bbe342b8fc service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:24.515086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 722/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:26.569983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c396af-3a95-48c5-a7fe-175764cbe773 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:26.570551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c396af-3a95-48c5-a7fe-175764cbe773 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:26.570551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c396af-3a95-48c5-a7fe-175764cbe773 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:26.571907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:26.577349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245907-1437-4d5c-a0b3-9245d502ec60 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:26.577794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245907-1437-4d5c-a0b3-9245d502ec60 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:26.577899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e245907-1437-4d5c-a0b3-9245d502ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:26.645453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0e245907-1437-4d5c-a0b3-9245d502ec60 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:26.646693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0e245907-1437-4d5c-a0b3-9245d502ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:26.660727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:26.760277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:27.044655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c396af-3a95-48c5-a7fe-175764cbe773 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:27.047097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-01c396af-3a95-48c5-a7fe-175764cbe773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:27.160298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c396af-3a95-48c5-a7fe-175764cbe773 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:27.173118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:27.241581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:27.242187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:27.242462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:27.242731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:27.244368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:27.359517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:27.361039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e692-99d7-44cc-9b61-f70c3f2971da service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:27.379630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 723/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:29.604163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e14c2-c645-4e41-beb8-570e05304040 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:29.605068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e14c2-c645-4e41-beb8-570e05304040 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:29.605068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e14c2-c645-4e41-beb8-570e05304040 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:29.607235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:29.614034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a0ffe-ef70-410a-941e-81caa6ed94d4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:29.614510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a0ffe-ef70-410a-941e-81caa6ed94d4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:29.614599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a0ffe-ef70-410a-941e-81caa6ed94d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:29.671774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:29.691182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e85a0ffe-ef70-410a-941e-81caa6ed94d4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:29.692507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e85a0ffe-ef70-410a-941e-81caa6ed94d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:29.799615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:30.093516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e14c2-c645-4e41-beb8-570e05304040 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:30.095483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-344e14c2-c645-4e41-beb8-570e05304040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:30.205686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e14c2-c645-4e41-beb8-570e05304040 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:30.245879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:30.281665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:30.282270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:30.282536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:30.282828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:30.284419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:30.395808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:30.397234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f96fc6-6035-4130-9c0f-cd54eae91c8c service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:30.416564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 725/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:32.432940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96aabb-f0e3-4c22-9302-be3fa8552650 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:32.433565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96aabb-f0e3-4c22-9302-be3fa8552650 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:32.433565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96aabb-f0e3-4c22-9302-be3fa8552650 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:32.434855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:32.441125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f39ef-5103-4c84-a06e-af5c1dd09047 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:32.441907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f39ef-5103-4c84-a06e-af5c1dd09047 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:32.442090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f39ef-5103-4c84-a06e-af5c1dd09047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:32.514998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c15f39ef-5103-4c84-a06e-af5c1dd09047 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:32.516262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c15f39ef-5103-4c84-a06e-af5c1dd09047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:32.537105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:32.616739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:32.905825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96aabb-f0e3-4c22-9302-be3fa8552650 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:32.907526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7f96aabb-f0e3-4c22-9302-be3fa8552650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:33.015670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96aabb-f0e3-4c22-9302-be3fa8552650 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:33.037987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:33.091195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:33.091800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:33.092074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:33.092343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:33.093955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:33.206550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:33.207944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f81fa-7ea4-45dc-9534-6e137f12090b service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:33.232077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 726/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:35.131631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a8964-7a8d-461a-8de9-98e77a55c87e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:35.132458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a8964-7a8d-461a-8de9-98e77a55c87e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:35.132458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a8964-7a8d-461a-8de9-98e77a55c87e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:35.134469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:35.142611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f23d2b-2f8f-4e1d-9fb6-3e208ff3bfd6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:35.143087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f23d2b-2f8f-4e1d-9fb6-3e208ff3bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:35.143200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f23d2b-2f8f-4e1d-9fb6-3e208ff3bfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:35.211398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:35.213891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-55f23d2b-2f8f-4e1d-9fb6-3e208ff3bfd6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:35.215199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-55f23d2b-2f8f-4e1d-9fb6-3e208ff3bfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:35.325431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:35.605674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a8964-7a8d-461a-8de9-98e77a55c87e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:35.607283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1f0a8964-7a8d-461a-8de9-98e77a55c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:35.720505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a8964-7a8d-461a-8de9-98e77a55c87e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:35.772073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:35.797445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:35.798037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:35.798308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:35.798575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:35.800215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:35.914074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:35.915455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038476de-9aec-42ac-8d5a-042d64648388 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:35.933360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 728/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:41:37.892208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a89f0-e38c-44ab-badd-dd987f8e3ea4 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:37.893075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a89f0-e38c-44ab-badd-dd987f8e3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:37.893075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a89f0-e38c-44ab-badd-dd987f8e3ea4 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:37.895700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:37.904884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99196439-32d8-4e28-8222-a36efe2f5ff8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:37.905633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99196439-32d8-4e28-8222-a36efe2f5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:37.905756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99196439-32d8-4e28-8222-a36efe2f5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:37.984734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-99196439-32d8-4e28-8222-a36efe2f5ff8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:37.985911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-99196439-32d8-4e28-8222-a36efe2f5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:38.016955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:38.094416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:38.376550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a89f0-e38c-44ab-badd-dd987f8e3ea4 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:38.379396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-948a89f0-e38c-44ab-badd-dd987f8e3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:38.491681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a89f0-e38c-44ab-badd-dd987f8e3ea4 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:38.528104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:38.574299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:38.574942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:38.575221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:38.575489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:38.577083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:38.691844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:38.693202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3006a3-7972-4aac-ae9b-a109020039e3 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:38.713830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 729/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:40.642335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b08fc-afb3-4965-85c7-67e97c9edbec None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:40.643277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b08fc-afb3-4965-85c7-67e97c9edbec None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:40.643277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b08fc-afb3-4965-85c7-67e97c9edbec None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:40.645816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:40.654539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97bafe-048a-4939-b078-4a2a60b921b8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:40.654992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97bafe-048a-4939-b078-4a2a60b921b8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:40.655215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97bafe-048a-4939-b078-4a2a60b921b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:40.725142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-af97bafe-048a-4939-b078-4a2a60b921b8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:40.726350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-af97bafe-048a-4939-b078-4a2a60b921b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:40.734904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:40.827144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:41.115448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b08fc-afb3-4965-85c7-67e97c9edbec None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:41.117985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-218b08fc-afb3-4965-85c7-67e97c9edbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:41.230491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b08fc-afb3-4965-85c7-67e97c9edbec None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:41.295989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:41.316975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:41.317578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:41.317849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:41.318112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:41.319783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:41.436647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:41.438102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f907bc-597d-4c6c-9df0-e7309147e0f8 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:41.457109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 731/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:43.384221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc909-8283-466b-8066-39b468d80668 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:43.384810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc909-8283-466b-8066-39b468d80668 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:43.384810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72bc909-8283-466b-8066-39b468d80668 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:43.386106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:43.391594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed8b8-2d03-4d6c-a480-371cfef2a534 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:43.392021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed8b8-2d03-4d6c-a480-371cfef2a534 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:43.392114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed8b8-2d03-4d6c-a480-371cfef2a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:43.459834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-970ed8b8-2d03-4d6c-a480-371cfef2a534 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:43.460932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-970ed8b8-2d03-4d6c-a480-371cfef2a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:43.516231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:43.584372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:43.862724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc909-8283-466b-8066-39b468d80668 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:43.864274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e72bc909-8283-466b-8066-39b468d80668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:43.983678 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72bc909-8283-466b-8066-39b468d80668 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:44.023878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:44.061048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:44.061655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:44.061932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:44.062211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:44.063969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:44.180399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:44.181744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d68a3-6819-46d6-833e-9dd0f0e470d3 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:44.200488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 732/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:46.105589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c7dd0-2d81-407b-b5ad-8a4bf42a8aee None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:46.106480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c7dd0-2d81-407b-b5ad-8a4bf42a8aee None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:46.106480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c7dd0-2d81-407b-b5ad-8a4bf42a8aee None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:46.108669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:46.117229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7abe2-5334-4123-abea-013cf4278a0e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:46.117659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7abe2-5334-4123-abea-013cf4278a0e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:46.117794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7abe2-5334-4123-abea-013cf4278a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:46.190033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ffa7abe2-5334-4123-abea-013cf4278a0e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:46.191285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ffa7abe2-5334-4123-abea-013cf4278a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:46.210497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:46.294985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:46.578494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c7dd0-2d81-407b-b5ad-8a4bf42a8aee None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:46.580076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-357c7dd0-2d81-407b-b5ad-8a4bf42a8aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:46.695787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c7dd0-2d81-407b-b5ad-8a4bf42a8aee None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:46.766801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:46.775125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:46.775731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:46.776013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:46.776279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:46.777889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:46.910439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:46.911930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784e0c9-bb48-4a7f-b740-f51d2a05519a service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:46.931246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 734/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:48.950312 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5ad2-fe57-4669-9681-cd73646a6ee5 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:48.951192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5ad2-fe57-4669-9681-cd73646a6ee5 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:48.951346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5ad2-fe57-4669-9681-cd73646a6ee5 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:48.953264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:41:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:41:48.959080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e255a-35ef-4977-89a9-f7dc6afd9002 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:48.959525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e255a-35ef-4977-89a9-f7dc6afd9002 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:48.959635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e255a-35ef-4977-89a9-f7dc6afd9002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:49.027314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ce9e255a-35ef-4977-89a9-f7dc6afd9002 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:41:49.028558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ce9e255a-35ef-4977-89a9-f7dc6afd9002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:49.078810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:49.130444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:41:49.410645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5ad2-fe57-4669-9681-cd73646a6ee5 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:41:49.413055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7fbe5ad2-fe57-4669-9681-cd73646a6ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:49.531765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5ad2-fe57-4669-9681-cd73646a6ee5 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:41:49.585121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:49.613718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:41:49.614329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:41:49.614612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:41:49.614910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:41:49.616540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:41:49.731125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:41:49.732434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a96b12-90fb-41e9-b1a4-f498a4eb0feb service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:41:49.750606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 735/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:41:59.128569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=22 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:41:59.748419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=66 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:08.927046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d126e-45bb-4a26-9f4d-0b6d1ec0129d None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:08.927580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d126e-45bb-4a26-9f4d-0b6d1ec0129d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:08.927580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d126e-45bb-4a26-9f4d-0b6d1ec0129d None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:08.928916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 736/1471] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:08.934944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00944-07c9-4c7b-adc5-44dc49a7c01f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:08.935428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00944-07c9-4c7b-adc5-44dc49a7c01f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:08.935537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a00944-07c9-4c7b-adc5-44dc49a7c01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:09.008823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-60a00944-07c9-4c7b-adc5-44dc49a7c01f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:09.010024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-60a00944-07c9-4c7b-adc5-44dc49a7c01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:09.112385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 736/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:42:09.420433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d8c46-4a4d-48e3-93eb-e2363a47371b None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:09.420966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d8c46-4a4d-48e3-93eb-e2363a47371b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:09.421251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d8c46-4a4d-48e3-93eb-e2363a47371b None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:09.422580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 737/1473] 10.222.0.26 () {54 vars in 967 bytes} [Fri Aug 12 10:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:09.427603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9efbc5-2eb1-4f67-9154-9ec7712d1cd6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:09.427910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9efbc5-2eb1-4f67-9154-9ec7712d1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:09.428176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9efbc5-2eb1-4f67-9154-9ec7712d1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:09.507801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ab9efbc5-2eb1-4f67-9154-9ec7712d1cd6 None None] MFA Rules not processed for user `b37e24a9e7d74e1ca95f6061beeb9343`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:09.508991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ab9efbc5-2eb1-4f67-9154-9ec7712d1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:09.531285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:09.588470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 737/1474] 10.222.0.26 () {58 vars in 1064 bytes} [Fri Aug 12 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:42:09.596472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d8c46-4a4d-48e3-93eb-e2363a47371b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:09.597992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8d7d8c46-4a4d-48e3-93eb-e2363a47371b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:09.710054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d8c46-4a4d-48e3-93eb-e2363a47371b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:09.784544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:09.785169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:09.785442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:09.785694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:09.787316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:09.841794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:09.901403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:09.902870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bd876-7a29-4b3f-a477-56e5abb0519d service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:09.922885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 738/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:42:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:42:11.917577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ea295-b57b-4257-926a-2ed4784f1f21 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:11.918480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ea295-b57b-4257-926a-2ed4784f1f21 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:11.918480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ea295-b57b-4257-926a-2ed4784f1f21 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:11.920601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 738/1476] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:11.929337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941de0-46ef-4234-b4e8-3fbbb12686c5 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:11.930047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941de0-46ef-4234-b4e8-3fbbb12686c5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:11.930197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1941de0-46ef-4234-b4e8-3fbbb12686c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:12.000389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b1941de0-46ef-4234-b4e8-3fbbb12686c5 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:12.001608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b1941de0-46ef-4234-b4e8-3fbbb12686c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:12.104430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 739/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:42:12.370518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ea295-b57b-4257-926a-2ed4784f1f21 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:12.373003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-558ea295-b57b-4257-926a-2ed4784f1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:12.519026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ea295-b57b-4257-926a-2ed4784f1f21 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:12.571007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:12.618454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:12.619078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:12.619349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:12.619617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:12.620248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:12.622010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:42:12.622010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:42:12.622010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:42:12.623117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6bf35-68ab-4b92-8afb-de173cd6f560 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:12.643001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 739/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 10:42:12 2022] GET /identity/v3/projects => generated 2553 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:42:14.541168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8015-4f7d-4e64-896b-5b114f117da8 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:14.542038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8015-4f7d-4e64-896b-5b114f117da8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:14.542038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bd8015-4f7d-4e64-896b-5b114f117da8 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:14.544127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 740/1479] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:14.550292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d2d6-4c1b-4b14-947b-f6b0c193aa49 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:14.550800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d2d6-4c1b-4b14-947b-f6b0c193aa49 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:14.550896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425d2d6-4c1b-4b14-947b-f6b0c193aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:14.618453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2425d2d6-4c1b-4b14-947b-f6b0c193aa49 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:14.619674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2425d2d6-4c1b-4b14-947b-f6b0c193aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:14.724493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 740/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:42:15.019492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8015-4f7d-4e64-896b-5b114f117da8 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:15.021085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e5bd8015-4f7d-4e64-896b-5b114f117da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:15.031464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:15.174620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bd8015-4f7d-4e64-896b-5b114f117da8 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:15.272078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:15.307444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:15.308049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:15.308324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:15.308585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:15.310243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:15.404959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:15.406557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ef5cd-cc28-40f9-b9c8-9f6696908bd2 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:15.428603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 741/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:42:17.495137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98c9e-f5dd-4133-8950-f6f667748e2d None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:17.496001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98c9e-f5dd-4133-8950-f6f667748e2d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:17.496001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af98c9e-f5dd-4133-8950-f6f667748e2d None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:17.498207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 741/1482] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:17.506295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b055f2-18bd-4eda-94d0-e52ed760c783 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:17.506778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b055f2-18bd-4eda-94d0-e52ed760c783 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:17.506899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b055f2-18bd-4eda-94d0-e52ed760c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:17.573006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d0b055f2-18bd-4eda-94d0-e52ed760c783 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:17.574209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d0b055f2-18bd-4eda-94d0-e52ed760c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:17.625219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:17.681616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 742/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:42:17.969700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af98c9e-f5dd-4133-8950-f6f667748e2d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:17.971343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8af98c9e-f5dd-4133-8950-f6f667748e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:18.000136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:18.095708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af98c9e-f5dd-4133-8950-f6f667748e2d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:18.183014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:18.183626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:18.183898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:18.184167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:18.185786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:18.264249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:18.303792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:18.305256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8235d53-3f21-4ccf-bd2a-da018fb39449 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:18.324837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 742/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:42:20.254471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69b79-631f-4aad-8f2b-a68bd3853df5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:20.255070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69b79-631f-4aad-8f2b-a68bd3853df5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:20.255070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b69b79-631f-4aad-8f2b-a68bd3853df5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:20.256280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 743/1485] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:42:20.262485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c53f9-230f-47ed-8eda-4a8145f75b11 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:20.263306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c53f9-230f-47ed-8eda-4a8145f75b11 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:20.263481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c53f9-230f-47ed-8eda-4a8145f75b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:20.338627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ff8c53f9-230f-47ed-8eda-4a8145f75b11 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:20.339912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ff8c53f9-230f-47ed-8eda-4a8145f75b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:20.452467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 743/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:42:20.744196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69b79-631f-4aad-8f2b-a68bd3853df5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:20.746564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-16b69b79-631f-4aad-8f2b-a68bd3853df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:20.858393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b69b79-631f-4aad-8f2b-a68bd3853df5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:20.931156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:20.933145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:20.933823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:20.934125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:20.934405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:20.936542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:21.056228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:21.057675 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38b66-1a1d-4955-8003-fb1992689761 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:21.076839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 744/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:42:23.093172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603a68-c101-4f64-8c60-abf3dab7f0ec None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:23.094081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603a68-c101-4f64-8c60-abf3dab7f0ec None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:23.094081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78603a68-c101-4f64-8c60-abf3dab7f0ec None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:23.096419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 744/1488] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:23.102001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f2e16-8fdf-49e1-8d42-551741616151 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:23.102452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f2e16-8fdf-49e1-8d42-551741616151 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:23.102574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f2e16-8fdf-49e1-8d42-551741616151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:23.184607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-157f2e16-8fdf-49e1-8d42-551741616151 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:23.186136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-157f2e16-8fdf-49e1-8d42-551741616151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:23.244759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:23.292324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 745/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:42:23.585281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78603a68-c101-4f64-8c60-abf3dab7f0ec None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:23.587779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-78603a68-c101-4f64-8c60-abf3dab7f0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:23.632303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:23.710782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78603a68-c101-4f64-8c60-abf3dab7f0ec None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:23.793110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:23.793707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:23.793981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:23.794251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:23.795930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:23.891263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:23.923535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:23.924989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1282d2-c994-460e-81f2-5a15b21b26df service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:23.945515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 745/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:42:26.097542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46271a5-8334-4c2e-9984-1815bf43822a None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:26.098150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46271a5-8334-4c2e-9984-1815bf43822a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:26.098150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46271a5-8334-4c2e-9984-1815bf43822a None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:26.099487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 746/1491] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 10:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:42:26.105925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049ba9d-a6ac-4e6d-a88b-371f960d8bb1 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:26.106642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049ba9d-a6ac-4e6d-a88b-371f960d8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:26.106854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049ba9d-a6ac-4e6d-a88b-371f960d8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:26.185626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3049ba9d-a6ac-4e6d-a88b-371f960d8bb1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:42:26.186906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3049ba9d-a6ac-4e6d-a88b-371f960d8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:26.287821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 746/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:42:26.578929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46271a5-8334-4c2e-9984-1815bf43822a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:42:26.581280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a46271a5-8334-4c2e-9984-1815bf43822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:26.699797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46271a5-8334-4c2e-9984-1815bf43822a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:42:26.776978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:42:26.777579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:42:26.777852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:42:26.778120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:42:26.779895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:42:26.788901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:26.904690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:42:26.906147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d93bd8-3df2-47c2-bcde-839565f513d3 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:42:26.925009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 747/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:42:36.285875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=82 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:42:36.922530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=50 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:44.714870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:44.715814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:44.715814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:44.801220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:43:44.802404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:44.904849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 747/1494] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:43:44.913830 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:44.914340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:44.914448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:45.000224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:43:45.001433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:45.098232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 748/1495] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:43:45.103918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:45.105729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:45.122499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949dbc2-21a5-40bf-940c-dd0115f72d5e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:45.186835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:45.224281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:45.224901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:45.225185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:45.225454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:45.226095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:43:45.226391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:45.227452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:45.227452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:43:45.227452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:43:45.228328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:45.240269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 748/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:43:45.252959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:45.262868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de61848-9e74-4eaa-81bd-498ba6d464dd None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:45.324921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:45.371502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:45.372106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:45.372373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:45.372634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:45.373256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:45.375028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:45.375028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:43:45.375028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:43:45.376214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:45.437616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 749/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:43:45 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:43:45.441949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:45.443515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:45.478498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ab7be-5aa2-4468-8b38-8fce8e81a6da admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:45.582696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:45.583308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:45.583589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:45.583847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:45.584486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:45.585528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:45.585528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:43:45.585528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:43:45.586752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:45.634669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 749/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:43:45 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:43:45.638911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:45.640570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:45.704608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed521a9-c817-4f5b-9be5-3c7edbdb4142 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:45.795129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:45.807063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:45.807663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:45.807936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:45.808242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:45.808876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:45.809892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:45.809892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:43:45.809892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:43:45.810797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:45.823272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 750/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:43:45.827616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:45.829140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:45.840776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5d2fd-158d-4350-96b3-707a55bac61b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:45.869436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:45.956372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:45.956982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:45.957253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:45.957518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:45.958159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:45.959225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:45.959225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:43:45.959225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:43:45.960109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcd062-4272-41d1-b3b7-24f0ae801b32 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:45.973295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 750/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:43:45.978083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:45.979687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:46.014435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809419ec-92a4-4d29-a21a-c8f2c55569cf admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:46.110884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:46.111464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:46.111736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:46.112002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] PATH_INFO: `/v3/projects/715385fd13e54b61904924c502431f49/users/5b37e05b9b3b4614a751071030e0da65/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:46.134096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715385fd13e54b61904924c502431f49, user_id=5b37e05b9b3b4614a751071030e0da65, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:46.135183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:46.135183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:43:46.135183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:43:46.137216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c1281-bc76-4928-b68e-0b3886f6cab4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:46.172810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 751/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:43:45 2022] PUT /identity/v3/projects/715385fd13e54b61904924c502431f49/users/5b37e05b9b3b4614a751071030e0da65/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:43:46.185322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec02c8-f0dc-4e9c-b7ce-13a49a11f7ef None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:46.185606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec02c8-f0dc-4e9c-b7ce-13a49a11f7ef None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:46.185880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec02c8-f0dc-4e9c-b7ce-13a49a11f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:46.245917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3eec02c8-f0dc-4e9c-b7ce-13a49a11f7ef None None] MFA Rules not processed for user `5b37e05b9b3b4614a751071030e0da65`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:43:46.247144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3eec02c8-f0dc-4e9c-b7ce-13a49a11f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:46.325510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 751/1502] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:43:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:43:46.339154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301629a7-62ea-401c-8a24-c6bd744e45a4 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:46.339466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301629a7-62ea-401c-8a24-c6bd744e45a4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:46.339761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301629a7-62ea-401c-8a24-c6bd744e45a4 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:46.341176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 752/1503] 10.222.0.26 () {54 vars in 964 bytes} [Fri Aug 12 10:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:43:46.346200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f886817-5bb2-455c-9f32-fc4e7a84e674 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:46.346477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f886817-5bb2-455c-9f32-fc4e7a84e674 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:46.346772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f886817-5bb2-455c-9f32-fc4e7a84e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:46.379410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:46.425662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6f886817-5bb2-455c-9f32-fc4e7a84e674 None None] MFA Rules not processed for user `044f1d33d9be4cdc827237fae316db0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:43:46.426904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6f886817-5bb2-455c-9f32-fc4e7a84e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:46.510040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 752/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Aug 12 10:43:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:43:46.518493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301629a7-62ea-401c-8a24-c6bd744e45a4 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:46.520117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-301629a7-62ea-401c-8a24-c6bd744e45a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:46.573445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:46.633848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301629a7-62ea-401c-8a24-c6bd744e45a4 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:46.712163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:46.712767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:46.713040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:46.713302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:46.714966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:46.817812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:46.819282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:46.822807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:46.839253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 753/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:43:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:43:46.884294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e0be2-00a7-45c2-a1da-a9a456096156 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:46.884688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e0be2-00a7-45c2-a1da-a9a456096156 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:46.884777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e0be2-00a7-45c2-a1da-a9a456096156 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:46.886039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 753/1506] 10.222.0.26 () {52 vars in 830 bytes} [Fri Aug 12 10:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:43:46.889772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:46.891046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:46.994766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcead0-7faa-41e8-b1ec-be32de50a1bd service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:47.093618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:47.094237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:47.094509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:47.094845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] PATH_INFO: `/v3/users/5b37e05b9b3b4614a751071030e0da65` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:47.107154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b37e05b9b3b4614a751071030e0da65)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:47.108181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:47.108181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:43:47.108181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:43:47.109380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:47.119013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:47.190728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b37e05b9b3b4614a751071030e0da65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:47.205045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b37e05b9b3b4614a751071030e0da65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:47.217201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b37e05b9b3b4614a751071030e0da65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:47.217638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b37e05b9b3b4614a751071030e0da65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:47.240587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b37e05b9b3b4614a751071030e0da65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:47.246499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 754/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:43:46 2022] DELETE /identity/v3/users/5b37e05b9b3b4614a751071030e0da65 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:43:47.251017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:47.251298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:47.251568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:47.310371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:43:47.311607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:47.403827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:47.417472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 754/1508] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:43:47.427341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:47.428581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:47.542864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e62c24-485f-45e7-bc26-65e2adde46a0 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:47.598530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:47.637667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:47.638279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:47.638552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:47.638862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:47.640477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:47.754355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:47.756026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30aca0-ba39-4420-bf59-9b95b17fa2a4 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:47.778613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 755/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:43:48.123856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:43:48.125429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:43:48.139704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c954f5-60cd-469f-8671-d5d585187296 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:43:48.256425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:43:48.257057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:43:48.257332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:43:48.257601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] PATH_INFO: `/v3/projects/715385fd13e54b61904924c502431f49` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:43:48.268390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715385fd13e54b61904924c502431f49)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:43:48.269428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:48.269428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:43:48.269428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:43:48.270617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:43:48.332204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715385fd13e54b61904924c502431f49', 'request_id': 'req-7f044e0f-76ce-40a7-bb18-0666b0444819'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:48.338296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715385fd13e54b61904924c502431f49', 'request_id': 'req-7f044e0f-76ce-40a7-bb18-0666b0444819'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:48.352797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715385fd13e54b61904924c502431f49', 'request_id': 'req-7f044e0f-76ce-40a7-bb18-0666b0444819'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:48.380044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] The token cache is being invalidate because project 715385fd13e54b61904924c502431f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:43:48.380249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:48.380658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f044e0f-76ce-40a7-bb18-0666b0444819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:43:48.382089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 755/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:43:48 2022] DELETE /identity/v3/projects/715385fd13e54b61904924c502431f49 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:43:57.775814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=62 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:58.377834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:22.629132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93dd6-623a-4911-8eb9-c18e65a0946e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:22.630053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93dd6-623a-4911-8eb9-c18e65a0946e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:22.630053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd93dd6-623a-4911-8eb9-c18e65a0946e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:22.632064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:22.638957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed4d6-73c7-47e0-a9e8-1a5c6019e354 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:22.639425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed4d6-73c7-47e0-a9e8-1a5c6019e354 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:22.639532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ed4d6-73c7-47e0-a9e8-1a5c6019e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:22.725970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-074ed4d6-73c7-47e0-a9e8-1a5c6019e354 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:22.727211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-074ed4d6-73c7-47e0-a9e8-1a5c6019e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:22.837859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:22.990077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93dd6-623a-4911-8eb9-c18e65a0946e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:22.993584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ecd93dd6-623a-4911-8eb9-c18e65a0946e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:23.125847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd93dd6-623a-4911-8eb9-c18e65a0946e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:23.132290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ed4b-e1ca-41fc-bcb6-0582e9b82cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:23.132890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ed4b-e1ca-41fc-bcb6-0582e9b82cf1 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:23.133162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ed4b-e1ca-41fc-bcb6-0582e9b82cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:23.133438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ed4b-e1ca-41fc-bcb6-0582e9b82cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:23.144432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ed4b-e1ca-41fc-bcb6-0582e9b82cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:23.146031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ed4b-e1ca-41fc-bcb6-0582e9b82cf1 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:23.155744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 757/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:23.984760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672556-80b4-48cd-9ce7-8879a9aef652 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:23.985583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672556-80b4-48cd-9ce7-8879a9aef652 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:23.985741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf672556-80b4-48cd-9ce7-8879a9aef652 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:23.987637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:23.995055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017bd82-deb1-48f8-98a8-0050fadd300a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:23.995764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017bd82-deb1-48f8-98a8-0050fadd300a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:23.995927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017bd82-deb1-48f8-98a8-0050fadd300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:24.017567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b017bd82-deb1-48f8-98a8-0050fadd300a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:24.018826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b017bd82-deb1-48f8-98a8-0050fadd300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:24.028380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:24.179522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672556-80b4-48cd-9ce7-8879a9aef652 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:24.203157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf672556-80b4-48cd-9ce7-8879a9aef652 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:24.209565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91e04f-0c41-43e8-88da-61f463dbd701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:24.210155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e04f-0c41-43e8-88da-61f463dbd701 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:24.210429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e04f-0c41-43e8-88da-61f463dbd701 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:24.210700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91e04f-0c41-43e8-88da-61f463dbd701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:24.219528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91e04f-0c41-43e8-88da-61f463dbd701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:24.221121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91e04f-0c41-43e8-88da-61f463dbd701 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:24.230988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 758/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:24.324099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5fc42-45b3-42b3-988f-19d463f9afcd None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:24.324464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5fc42-45b3-42b3-988f-19d463f9afcd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:24.324665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5fc42-45b3-42b3-988f-19d463f9afcd None None] PATH_INFO: `/v3` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:24.325987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 759/1517] 10.222.0.33 () {54 vars in 925 bytes} [Fri Aug 12 10:45:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:45:24.333119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652875d4-9a6e-403e-ae6f-16a9b3edbc26 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:24.333595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652875d4-9a6e-403e-ae6f-16a9b3edbc26 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:24.333939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652875d4-9a6e-403e-ae6f-16a9b3edbc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:24.397213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-652875d4-9a6e-403e-ae6f-16a9b3edbc26 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:24.398405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-652875d4-9a6e-403e-ae6f-16a9b3edbc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:24.415616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:24.477827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 759/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Aug 12 10:45:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:33.271895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096eb9-1db5-41cd-923c-2dedd5836548 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:33.272491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096eb9-1db5-41cd-923c-2dedd5836548 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:33.272491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096eb9-1db5-41cd-923c-2dedd5836548 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:33.273670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 760/1519] 10.222.0.26 () {54 vars in 961 bytes} [Fri Aug 12 10:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:45:33.278857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd510d-354e-4567-a67b-6cff0e9b3e40 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:33.279312 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd510d-354e-4567-a67b-6cff0e9b3e40 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:33.279423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd510d-354e-4567-a67b-6cff0e9b3e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:33.299714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-68cd510d-354e-4567-a67b-6cff0e9b3e40 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:33.300916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-68cd510d-354e-4567-a67b-6cff0e9b3e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:33.309871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 760/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Aug 12 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:33.317535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096eb9-1db5-41cd-923c-2dedd5836548 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:33.332678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096eb9-1db5-41cd-923c-2dedd5836548 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:33.338457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bec621-8069-48d5-89c2-f853fb255357 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:33.339061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec621-8069-48d5-89c2-f853fb255357 service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:33.339330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec621-8069-48d5-89c2-f853fb255357 service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:33.339597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bec621-8069-48d5-89c2-f853fb255357 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:33.348542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec621-8069-48d5-89c2-f853fb255357 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:33.350110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bec621-8069-48d5-89c2-f853fb255357 service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:33.359834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 761/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:35.465694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893fb99-7a03-4a48-ab7b-de5ad782f73b None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:35.466292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893fb99-7a03-4a48-ab7b-de5ad782f73b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:35.466292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893fb99-7a03-4a48-ab7b-de5ad782f73b None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:35.467605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:35.473367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268405-65ba-4730-a631-f71dad5f78e2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:35.473813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268405-65ba-4730-a631-f71dad5f78e2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:35.473924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268405-65ba-4730-a631-f71dad5f78e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:35.497293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-12268405-65ba-4730-a631-f71dad5f78e2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:35.498507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-12268405-65ba-4730-a631-f71dad5f78e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:35.507334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:35.663331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893fb99-7a03-4a48-ab7b-de5ad782f73b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:35.678780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893fb99-7a03-4a48-ab7b-de5ad782f73b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:35.684780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d513e5-e92c-47b5-b80a-674438b5a8f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:35.685378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d513e5-e92c-47b5-b80a-674438b5a8f9 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:35.685679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d513e5-e92c-47b5-b80a-674438b5a8f9 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:35.685924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d513e5-e92c-47b5-b80a-674438b5a8f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:35.694473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d513e5-e92c-47b5-b80a-674438b5a8f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:35.696089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d513e5-e92c-47b5-b80a-674438b5a8f9 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:35.705914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 762/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:36.512521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42c60-06bc-4d31-9941-b864338c93b5 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:36.513456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42c60-06bc-4d31-9941-b864338c93b5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:36.513456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c42c60-06bc-4d31-9941-b864338c93b5 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:36.515656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 10:45:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:36.521578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e30a1-1853-491f-bfbc-8e630e84485f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:36.522353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e30a1-1853-491f-bfbc-8e630e84485f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:36.522511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e30a1-1853-491f-bfbc-8e630e84485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:36.545335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-646e30a1-1853-491f-bfbc-8e630e84485f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:36.546541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-646e30a1-1853-491f-bfbc-8e630e84485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:36.555535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 10:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:36.712258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c42c60-06bc-4d31-9941-b864338c93b5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:36.735808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c42c60-06bc-4d31-9941-b864338c93b5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:36.746286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e9db1-f044-4ea7-b956-afcf6f35ad1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:36.746910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e9db1-f044-4ea7-b956-afcf6f35ad1b service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:36.747184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e9db1-f044-4ea7-b956-afcf6f35ad1b service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:36.747445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e9db1-f044-4ea7-b956-afcf6f35ad1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:36.756280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e9db1-f044-4ea7-b956-afcf6f35ad1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:36.757858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e9db1-f044-4ea7-b956-afcf6f35ad1b service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:36.767783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 764/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:40.505745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62eb2b-45d1-482c-9101-200fbb8e36a2 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:40.506350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62eb2b-45d1-482c-9101-200fbb8e36a2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:40.506350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62eb2b-45d1-482c-9101-200fbb8e36a2 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:40.507632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:40.513831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e458-0157-408b-8f30-2925a450bf9e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:40.514593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e458-0157-408b-8f30-2925a450bf9e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:40.514849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695e458-0157-408b-8f30-2925a450bf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:40.547866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2695e458-0157-408b-8f30-2925a450bf9e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:40.549977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2695e458-0157-408b-8f30-2925a450bf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:40.562875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:40.847885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62eb2b-45d1-482c-9101-200fbb8e36a2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:40.851165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0e62eb2b-45d1-482c-9101-200fbb8e36a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:40.940508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62eb2b-45d1-482c-9101-200fbb8e36a2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:40.944865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbda92-9c43-4a5f-a138-80533e44cdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:40.945465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbda92-9c43-4a5f-a138-80533e44cdac service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:40.945740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbda92-9c43-4a5f-a138-80533e44cdac service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:40.946008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbda92-9c43-4a5f-a138-80533e44cdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:40.955685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbda92-9c43-4a5f-a138-80533e44cdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:40.957112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbda92-9c43-4a5f-a138-80533e44cdac service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:40.966557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 765/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:42.858489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41dde-c27a-4198-8693-11ea0a8d388f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:42.859095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41dde-c27a-4198-8693-11ea0a8d388f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:42.859095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be41dde-c27a-4198-8693-11ea0a8d388f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:42.860423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:42.866739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e07d-a96d-4592-b29f-cc7f455d7fb4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:42.867420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e07d-a96d-4592-b29f-cc7f455d7fb4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:42.867614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36e07d-a96d-4592-b29f-cc7f455d7fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:42.896152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cc36e07d-a96d-4592-b29f-cc7f455d7fb4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:42.897344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cc36e07d-a96d-4592-b29f-cc7f455d7fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:42.906189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:43.187834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41dde-c27a-4198-8693-11ea0a8d388f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:43.189985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2be41dde-c27a-4198-8693-11ea0a8d388f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:43.205668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be41dde-c27a-4198-8693-11ea0a8d388f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:43.209686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52de2-9fa8-467a-873d-140de5fafbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:43.210299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52de2-9fa8-467a-873d-140de5fafbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:43.210579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52de2-9fa8-467a-873d-140de5fafbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:43.210879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52de2-9fa8-467a-873d-140de5fafbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:43.220481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52de2-9fa8-467a-873d-140de5fafbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:43.221934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52de2-9fa8-467a-873d-140de5fafbe6 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:43.232143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 767/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:46.496185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d12a0-9942-4f48-a931-b844c2ae992f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:46.499045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d12a0-9942-4f48-a931-b844c2ae992f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:46.499045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d12a0-9942-4f48-a931-b844c2ae992f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:46.499045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:46.503529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce949d1-b598-489d-bcd0-2dc993012e88 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:46.504001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce949d1-b598-489d-bcd0-2dc993012e88 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:46.504103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce949d1-b598-489d-bcd0-2dc993012e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:46.526732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2ce949d1-b598-489d-bcd0-2dc993012e88 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:46.528423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2ce949d1-b598-489d-bcd0-2dc993012e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:46.538590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:45:47.082187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d12a0-9942-4f48-a931-b844c2ae992f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:47.084203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ca8d12a0-9942-4f48-a931-b844c2ae992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:47.154508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:47.168849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d12a0-9942-4f48-a931-b844c2ae992f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:47.172798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e7ea7-8ce0-4aa9-a91d-983d4b592625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:47.173392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7ea7-8ce0-4aa9-a91d-983d4b592625 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:47.173661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7ea7-8ce0-4aa9-a91d-983d4b592625 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:47.173925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e7ea7-8ce0-4aa9-a91d-983d4b592625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:47.183352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e7ea7-8ce0-4aa9-a91d-983d4b592625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:47.185198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e7ea7-8ce0-4aa9-a91d-983d4b592625 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:47.196119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 768/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:49.094100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be83-ba91-4c87-8328-6245f5f021b2 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:49.094956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be83-ba91-4c87-8328-6245f5f021b2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:49.095124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6be83-ba91-4c87-8328-6245f5f021b2 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:49.097146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 10:45:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:45:49.105038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cbb0a-3b4a-4b6b-a48b-c0d824f6f23a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:49.105496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cbb0a-3b4a-4b6b-a48b-c0d824f6f23a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:49.105668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cbb0a-3b4a-4b6b-a48b-c0d824f6f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:49.126260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-287cbb0a-3b4a-4b6b-a48b-c0d824f6f23a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:45:49.127523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-287cbb0a-3b4a-4b6b-a48b-c0d824f6f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:49.136817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:45:49.685732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6be83-ba91-4c87-8328-6245f5f021b2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:45:49.688355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9ca6be83-ba91-4c87-8328-6245f5f021b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:45:49.700273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=84 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:49.706931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca6be83-ba91-4c87-8328-6245f5f021b2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:45:49.710535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07031019-5b1a-411c-a1bf-d074c16f8a6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:45:49.711156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031019-5b1a-411c-a1bf-d074c16f8a6b service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:45:49.711431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031019-5b1a-411c-a1bf-d074c16f8a6b service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:45:49.711682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07031019-5b1a-411c-a1bf-d074c16f8a6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:45:49.720623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07031019-5b1a-411c-a1bf-d074c16f8a6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:45:49.722046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07031019-5b1a-411c-a1bf-d074c16f8a6b service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:45:49.731520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 770/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:45:59.120818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=11 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:59.727574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:12.950639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:12.970474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:12.970474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:12.986518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:12.990173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.004567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 770/1540] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:13.014382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.015037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.015037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.042473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.043940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.059898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 771/1541] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.065296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.082149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc5891-c845-47a2-bd73-3ba1f31c4567 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.091670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.092615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.093042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.093317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.093980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:13.094282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.095952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f8baf-1f31-4b6d-b438-209704b2b80e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.116738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 771/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:13.140498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.143535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6609a9-a511-4357-bad9-1e1e5e93533c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.143957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6609a9-a511-4357-bad9-1e1e5e93533c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.144236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6609a9-a511-4357-bad9-1e1e5e93533c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.166467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a360e-cf9b-4f5d-91ef-684c61e27a18 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.179229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.179863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.180136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.180402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.181037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.184502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.199730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2c6609a9-a511-4357-bad9-1e1e5e93533c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.201014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2c6609a9-a511-4357-bad9-1e1e5e93533c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.240545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 772/1543] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:13.251105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4941c-35a4-4827-932e-ea271eb2b2d7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.251440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4941c-35a4-4827-932e-ea271eb2b2d7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.251662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4941c-35a4-4827-932e-ea271eb2b2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.256445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 772/1544] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:13.263667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.300118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9ce4941c-35a4-4827-932e-ea271eb2b2d7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.301485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9ce4941c-35a4-4827-932e-ea271eb2b2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.357145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a0949-d479-41d4-aa8d-f0420b712fd1 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.374287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.375287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.375568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.375882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.376526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.377564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:47:13.377564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:47:13.377564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:47:13.380585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018bffc-188d-4818-850a-8b499e5108fa admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.425410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 773/1545] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:13.427231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585fcca-35e1-429d-91ca-a77fb7ff5aeb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.427516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585fcca-35e1-429d-91ca-a77fb7ff5aeb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.427783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585fcca-35e1-429d-91ca-a77fb7ff5aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.428611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 773/1546] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.430212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a17e-634f-428c-9c20-412bc13b73c6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.430515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a17e-634f-428c-9c20-412bc13b73c6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.430833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2a17e-634f-428c-9c20-412bc13b73c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.450435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f585fcca-35e1-429d-91ca-a77fb7ff5aeb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.452156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f585fcca-35e1-429d-91ca-a77fb7ff5aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.455931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5df2a17e-634f-428c-9c20-412bc13b73c6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.457184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5df2a17e-634f-428c-9c20-412bc13b73c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.461976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 774/1547] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.464359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.464870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.465383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.466722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 774/1548] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.468033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.468396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.469004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.488912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.490605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.491964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.493351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.499728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 775/1549] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.500742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.502984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 775/1550] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.510716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.515604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626401d-8f74-4787-8543-fc471b2e8a96 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.518009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0deb0a-cceb-4b17-bb72-e2cd7b09f6b0 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.520704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.521321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.521599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.521870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.522521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:13.522751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089548a8-30b6-43b9-a862-8f4432715deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.522868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.523331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089548a8-30b6-43b9-a862-8f4432715deb admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.523601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089548a8-30b6-43b9-a862-8f4432715deb admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.523863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089548a8-30b6-43b9-a862-8f4432715deb admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.524502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089548a8-30b6-43b9-a862-8f4432715deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.524604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188525c3-4faa-4ce2-87d9-f0f53db08bcc admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.528369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089548a8-30b6-43b9-a862-8f4432715deb admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.542017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 776/1551] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:13.542017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb493ea-2e76-4e3e-8a2f-51a5da137d90 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.542017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb493ea-2e76-4e3e-8a2f-51a5da137d90 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.542392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 776/1552] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:13.542479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb493ea-2e76-4e3e-8a2f-51a5da137d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.543524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739989-2b0f-463e-8e83-05feb90b90c4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.543809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739989-2b0f-463e-8e83-05feb90b90c4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.544081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e739989-2b0f-463e-8e83-05feb90b90c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.563633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0e739989-2b0f-463e-8e83-05feb90b90c4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.564825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0e739989-2b0f-463e-8e83-05feb90b90c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.565510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5cb493ea-2e76-4e3e-8a2f-51a5da137d90 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.567151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5cb493ea-2e76-4e3e-8a2f-51a5da137d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.572674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 777/1553] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.573927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b0ee-d55d-4b9e-90f8-5c0c261ca9c1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.574207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b0ee-d55d-4b9e-90f8-5c0c261ca9c1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.574471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03b0ee-d55d-4b9e-90f8-5c0c261ca9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.583002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 777/1554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.585707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.586217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.586744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.595748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-fa03b0ee-d55d-4b9e-90f8-5c0c261ca9c1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.597130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fa03b0ee-d55d-4b9e-90f8-5c0c261ca9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.605448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 778/1555] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.606738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.607003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.607249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.607591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.608604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.616338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 778/1556] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.617149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.626352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249487e5-aaad-4c3f-be14-bbaac39d83fe None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.628122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.629336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.630793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.631373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.631647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.631913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.632546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.634131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.637341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 779/1557] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.638138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.645574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 779/1558] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:13.645574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.650010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38bea3-dac4-4a85-aedf-1968d4a602fb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.654472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ee462-1d49-44b9-9a63-1a66483943f3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.654590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50bb358-e0b9-4e3c-b376-4de383ebecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.655204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bb358-e0b9-4e3c-b376-4de383ebecca admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.655482 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bb358-e0b9-4e3c-b376-4de383ebecca admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.655750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50bb358-e0b9-4e3c-b376-4de383ebecca admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.656593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bb358-e0b9-4e3c-b376-4de383ebecca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.658880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.659424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50bb358-e0b9-4e3c-b376-4de383ebecca admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.659537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.659713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.659984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.660634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:13.660910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.662454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.675301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 780/1559] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:13.676115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.686201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312017c-0b2a-49aa-b311-73ca9466f98f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.691273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.691872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.692148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.692417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.693187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:13.693493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.695120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6c97-2695-4402-bd58-b8ddd4b47716 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.697087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 780/1560] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:13.698430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.698789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.699112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.708093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 781/1561] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:13.709123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.709409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.709684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.721364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.722650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.729776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:13.731078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:13.762701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:13.781093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:13.782322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 781/1562] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.783418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.794075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 782/1563] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:13.795568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.795892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5f3b-dd2f-4afc-9deb-25403a6dcc0f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.802252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.802883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.803156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.803436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.804093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:13.804408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.805427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:47:13.805427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:47:13.805427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:47:13.806306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.808368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2844df-be21-4e2b-91be-745f22a295b8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.814128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.814899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.815231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.815626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.816432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:13.816913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.818744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 782/1564] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:13.818981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.823847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.830952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 783/1565] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:13.831724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.835988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0a23f-73b2-466f-a502-2b94a24547be admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.841570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.842388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.842718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a4d4-5d42-471c-bdbe-ea8e33710130 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.842842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.843247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] PATH_INFO: `/v3/projects/a8a7dec1117d44fbb1a176ca3171ea05/users/763b11870ee642c5b4adc5a1cfd879f8/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.847474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.848050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.848323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.848584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.849195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.850201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:47:13.850201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:47:13.850201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:47:13.851410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.862367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a7dec1117d44fbb1a176ca3171ea05, user_id=763b11870ee642c5b4adc5a1cfd879f8, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.865090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.881880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 784/1566] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:13.882705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.888101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 783/1567] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:13 2022] PUT /identity/v3/projects/a8a7dec1117d44fbb1a176ca3171ea05/users/763b11870ee642c5b4adc5a1cfd879f8/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:13.889306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:13.946315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7662a7-10b5-4c30-982e-2054da9cbb65 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.951266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4d0e3-cd02-4d96-96d8-edbb0851608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.951902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d0e3-cd02-4d96-96d8-edbb0851608a admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.952131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d0e3-cd02-4d96-96d8-edbb0851608a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.952244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e87cb8-42ab-469c-9858-243c479bf6ac admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:13.952397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4d0e3-cd02-4d96-96d8-edbb0851608a admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.953027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d0e3-cd02-4d96-96d8-edbb0851608a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.954968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4d0e3-cd02-4d96-96d8-edbb0851608a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.957116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:13.957727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.958015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.958329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.958923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:13.960856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:13.983627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 785/1568] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:13.983627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:13.983627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:13.983627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:13.992892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 784/1569] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:13.993726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.001856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:14.003080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:14.053881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1ac2e-d706-41ac-ad0c-14eac23c505e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.058700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.059325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.059594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.059857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.060495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:14.060812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.062406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.063795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 786/1570] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:14.067656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.081439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 785/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:14.081642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b2954-f5e2-4fc7-b7a2-f40dc26f8bc6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.081746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.084692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5068521-50c2-4ac5-9927-1353fcada91c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.084920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527439-166b-4101-907c-50b77af689db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.085659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527439-166b-4101-907c-50b77af689db admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.085932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527439-166b-4101-907c-50b77af689db admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.086199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13527439-166b-4101-907c-50b77af689db admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.086870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527439-166b-4101-907c-50b77af689db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.088837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13527439-166b-4101-907c-50b77af689db admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.089470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab0a8a-e2cb-4308-85bc-123e91995d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.090054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0a8a-e2cb-4308-85bc-123e91995d63 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.090326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0a8a-e2cb-4308-85bc-123e91995d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.090591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0a8a-e2cb-4308-85bc-123e91995d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.091238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab0a8a-e2cb-4308-85bc-123e91995d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.093118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab0a8a-e2cb-4308-85bc-123e91995d63 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.116976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 787/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.118252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527439-166b-4101-907c-50b77af689db admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.125002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 786/1573] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.125002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.125002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.125002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.136163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:14.143109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:14.144902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:14.155935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:14.185062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13527439-166b-4101-907c-50b77af689db admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.205470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 787/1574] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:14.209009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.218460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82761fa1-2a19-44b4-a96c-827c62e3df7e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.223391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.223998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.224587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.224587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.225215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.226907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.237522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 788/1575] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.238409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.246427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.247072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.247354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.247621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.247941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaba745-749d-4bae-be6e-17443fbca32c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.248246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.250178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.252632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.253205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.253475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.253746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.254353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.256269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.276732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 788/1576] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.276732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.285457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 789/1577] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/users => generated 293 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.285457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.285727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de4d4e-7b26-4923-af0d-9af69efd9c19 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.289708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.290313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.290593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.290925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.291597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:14.291901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.293487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dface9f-746d-4f59-92f0-87f3551a949c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.293629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.298392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.299015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.299294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.299562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.300179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.302067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.306506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 789/1578] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:14.307458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.317051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c29d-a9fd-486b-8103-1fb1013dbe87 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.321851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.322466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.322783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.323150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.323771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.325691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.336556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 790/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.337353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.354334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 790/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/users => generated 303 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.354334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.400242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c658353-c4e8-4f4f-ac8c-eadf5a7e7441 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.404960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.405586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.405873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.406151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.406811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.408793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.409806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e8fcb-8204-4b40-a416-fcf0fc5e384e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.433488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 791/1581] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.433488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.443619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b8959-f63d-4c4f-86bd-0d5c69af8fa2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.449020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.449619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.449897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.450166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.450913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.452555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.462509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 792/1582] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.463242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.467848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.468463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.468741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.469006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.472944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef46850-2117-4116-a155-ba811c0087f0 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.476407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:14.477637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.478261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.478557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.478702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.478947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.479789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.480117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.481373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.491916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 791/1583] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:14.492092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 793/1584] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.492873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.493031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.502927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d1f39-f1b8-41b3-bf2a-885e69d0c67d service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.503579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f411c3-b7f5-45ce-98c9-4d45f3afb00c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.508070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.508230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.508670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.508847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.508973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.509127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.509242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.509397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.509805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.510043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.511796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.511902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.524102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 794/1585] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.524995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.535074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc11c5-7aa1-43f7-96da-4a1451cf1095 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.540344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.541189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.541356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.542363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.542363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.544394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.551529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 792/1586] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.555475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.556590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:14.573055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 795/1587] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/users => generated 282 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.574029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.585663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2d26b-7c91-4dd1-9e12-466c448ea706 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.631752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7660c9-f127-4595-bd9a-4c09e40ce82b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.636927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.637615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.638094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.638440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.639230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.640864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.652380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.655997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 793/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.656120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.656120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.656363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.656473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.656473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.656473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.668814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a56477-78e1-413f-975a-e1efab2e32b8 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.673365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 796/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.673365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.674280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.674986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.675269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.675545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] PATH_INFO: `/v3/projects/8ceb3a17be2e4fd78ebf638c58325f38/users/afd753e2b6534bfc8f015ab1e9ed939d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.685592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583f45-7632-43f6-aaed-3d2dc9754efe admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.692699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.693015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ceb3a17be2e4fd78ebf638c58325f38, user_id=afd753e2b6534bfc8f015ab1e9ed939d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.693316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.693594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.693863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.694120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:47:14.694120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:47:14.694120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:47:14.694505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.696234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.696342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.710765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 797/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.711442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.714874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 794/1591] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:14 2022] PUT /identity/v3/projects/8ceb3a17be2e4fd78ebf638c58325f38/users/afd753e2b6534bfc8f015ab1e9ed939d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:14.715743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.735987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0784b88-508b-446b-ab9e-ca1d28016d71 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.798176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68338e99-c04f-40d9-8137-aeca212a1cce admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.802387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.803049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.803325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.803597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.804257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.805085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.805927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.806091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.806583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.807076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.808192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.811118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.819807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 798/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.820901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.840071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ddc81-12e3-4931-9da4-b18cd9440dac admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.847157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 795/1593] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/users => generated 296 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:14.849207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.850354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.851901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.852179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.852951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.855150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.857045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.862722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c5f3-829c-4641-afef-facb0915d04d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.867777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.868392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.868667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.868934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.869621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.871414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.872755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 799/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.873778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.885891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 796/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.885891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:14.890561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df7303-3470-4953-8a75-6a87a9690cd4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.896555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164469d-6ce0-48a1-9f59-b1f42021a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.897746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164469d-6ce0-48a1-9f59-b1f42021a248 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.898264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164469d-6ce0-48a1-9f59-b1f42021a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.898594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d999d5-349b-49ba-b721-6f53c28fb9c4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:14.899121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164469d-6ce0-48a1-9f59-b1f42021a248 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.900642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164469d-6ce0-48a1-9f59-b1f42021a248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.904189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:14.904698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164469d-6ce0-48a1-9f59-b1f42021a248 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.905245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.905631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.906263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] PATH_INFO: `/v3/projects/c51b4e47810f4efb90378eab161f0ebb/users/ee081ad8284348af88afe1a8c3dabc97/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.924079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 800/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:14.925886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:14.926173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:14.926461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:14.928710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51b4e47810f4efb90378eab161f0ebb, user_id=ee081ad8284348af88afe1a8c3dabc97, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:14.931783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:14.943007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:14.948154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:14.949374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:14.953598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 797/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:14 2022] PUT /identity/v3/projects/c51b4e47810f4efb90378eab161f0ebb/users/ee081ad8284348af88afe1a8c3dabc97/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:14.954534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.003072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:15.015698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 801/1598] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:15.016528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.027764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ac61-524b-4f54-bb61-0339eeec685c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.032687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.033301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.033574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.033842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.034479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.036141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cc42c-efaa-4c55-9c1c-64976bfe25c3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.036283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.041100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.041996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.042367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.042714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] PATH_INFO: `/v3/projects/0763c9be032f4928b5ba8ac6cc9fe2be/users/f1921e11db8e45e4af638755cc163823/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.051452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 802/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:15.051452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.059588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0763c9be032f4928b5ba8ac6cc9fe2be, user_id=f1921e11db8e45e4af638755cc163823, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.062318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.062712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ad698-57b5-4810-8057-ae3eb8eb173f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.068566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.069226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.069538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.069833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.071285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.073022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.078831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 798/1600] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:14 2022] PUT /identity/v3/projects/0763c9be032f4928b5ba8ac6cc9fe2be/users/f1921e11db8e45e4af638755cc163823/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:15.079571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.092531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 803/1601] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:15.092531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.104350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc65eec-d416-451c-b5fa-32d59468e266 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.156268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429db5c1-2661-4349-99f2-895b3ec1197f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.162374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f95ab-3be8-44bd-8f5f-19e5a5c7e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.163141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f95ab-3be8-44bd-8f5f-19e5a5c7e33f admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.163572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f95ab-3be8-44bd-8f5f-19e5a5c7e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.163858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f95ab-3be8-44bd-8f5f-19e5a5c7e33f admin admin] PATH_INFO: `/v3/projects/e2cb5be6941a4209bce284a6b5dc11b4/users/1b28ab6da436403985602aadb3f24b3c/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.169102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.169867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.170197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.170510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] PATH_INFO: `/v3/projects/8a1facfcc24741f3ac8c9dc2b7f7defa/users/860f9ea0d73f4f9280796a8e83c2faa1/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.181368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f95ab-3be8-44bd-8f5f-19e5a5c7e33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cb5be6941a4209bce284a6b5dc11b4, user_id=1b28ab6da436403985602aadb3f24b3c, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.183986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843f95ab-3be8-44bd-8f5f-19e5a5c7e33f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.190394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1facfcc24741f3ac8c9dc2b7f7defa, user_id=860f9ea0d73f4f9280796a8e83c2faa1, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.193447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.200920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 799/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:15 2022] PUT /identity/v3/projects/e2cb5be6941a4209bce284a6b5dc11b4/users/1b28ab6da436403985602aadb3f24b3c/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:15.204655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.204655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.204655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.209836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 804/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:15 2022] PUT /identity/v3/projects/8a1facfcc24741f3ac8c9dc2b7f7defa/users/860f9ea0d73f4f9280796a8e83c2faa1/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:15.210884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.225508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:15.226886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:15.295585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde669f-6c0d-4291-a68b-cda2943c2e0d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.299615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.300244 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 800/1604] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:15.301306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.310115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.310403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.310700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.312362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2107c6-f64f-46da-905d-79d7fa471595 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.317981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952b08-1a1d-44fd-a2b9-cbc09102e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.318865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952b08-1a1d-44fd-a2b9-cbc09102e514 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.319338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952b08-1a1d-44fd-a2b9-cbc09102e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.320493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952b08-1a1d-44fd-a2b9-cbc09102e514 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.321603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12952b08-1a1d-44fd-a2b9-cbc09102e514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.323324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.324101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12952b08-1a1d-44fd-a2b9-cbc09102e514 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.324961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.329589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:15.336795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 801/1605] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:15.338826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a530f66-5e47-421f-b5e6-fd377607f54f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.339556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a530f66-5e47-421f-b5e6-fd377607f54f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.340210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a530f66-5e47-421f-b5e6-fd377607f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.343258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 805/1606] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:15.344318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.354513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d6eaa-d01e-4523-bada-3a9aa001f500 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.360610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93622202-d7fd-4539-ab02-2e4d4a7dbbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.360860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2a530f66-5e47-421f-b5e6-fd377607f54f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:15.361692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93622202-d7fd-4539-ab02-2e4d4a7dbbf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.362140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93622202-d7fd-4539-ab02-2e4d4a7dbbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.362534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2a530f66-5e47-421f-b5e6-fd377607f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:15.362759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93622202-d7fd-4539-ab02-2e4d4a7dbbf6 admin admin] PATH_INFO: `/v3/projects/caeb3c42802d428c9421b0f51af1e351/users/91e83090d7464a16a5b737c3bb4fb94b/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.377048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 802/1607] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:15.380566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93622202-d7fd-4539-ab02-2e4d4a7dbbf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caeb3c42802d428c9421b0f51af1e351, user_id=91e83090d7464a16a5b737c3bb4fb94b, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.382433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.382639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93622202-d7fd-4539-ab02-2e4d4a7dbbf6 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.383069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.383486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.411818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 806/1608] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:15 2022] PUT /identity/v3/projects/caeb3c42802d428c9421b0f51af1e351/users/91e83090d7464a16a5b737c3bb4fb94b/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:15.411818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.411818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.411818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.418445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:15.420120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:15.434826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] MFA Rules not processed for user `860f9ea0d73f4f9280796a8e83c2faa1`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:15.436714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:15.470003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:15.508434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 803/1609] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:15.512019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.523872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 807/1610] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:15.524836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.547967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcf1b1-5d8f-45e9-8c81-60483a76791b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.562588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.563588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.564784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.565168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] PATH_INFO: `/v3/projects/94a5d3bae03c4e178cdc666b72432624/users/61e3692e4d0e4892abab3d6387fa001f/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.595048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a5d3bae03c4e178cdc666b72432624, user_id=61e3692e4d0e4892abab3d6387fa001f, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.601282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.620215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0048-358a-43d1-8434-eaa6be0d333c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.635709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 808/1611] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:15 2022] PUT /identity/v3/projects/94a5d3bae03c4e178cdc666b72432624/users/61e3692e4d0e4892abab3d6387fa001f/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:15.636587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.699562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135154d-96a7-45f1-802f-7e24bc90596f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.700234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135154d-96a7-45f1-802f-7e24bc90596f service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.700514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135154d-96a7-45f1-802f-7e24bc90596f service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.700781 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135154d-96a7-45f1-802f-7e24bc90596f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.715621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30cc31-5395-4520-aef9-2fec9555a6b3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.723964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.724848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.725289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.725704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.796739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:15.801862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135154d-96a7-45f1-802f-7e24bc90596f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.803685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135154d-96a7-45f1-802f-7e24bc90596f service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.838847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 804/1612] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:15.842160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.845391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.845821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.851726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.856788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.884156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 809/1613] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:15.885395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:15.899083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a0295-95b0-4891-aa43-407cf7c6d896 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:15.903893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d99e6-7511-4955-95d9-572d2da7bdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:15.904935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d99e6-7511-4955-95d9-572d2da7bdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.905373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d99e6-7511-4955-95d9-572d2da7bdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.905789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d99e6-7511-4955-95d9-572d2da7bdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.913716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] MFA Rules not processed for user `91e83090d7464a16a5b737c3bb4fb94b`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:15.916856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:15.938961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d99e6-7511-4955-95d9-572d2da7bdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:15.942906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d99e6-7511-4955-95d9-572d2da7bdf3 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:15.974020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 810/1614] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:15.975946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723b48f-62aa-483d-a7ff-9a932afa8b48 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.976233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723b48f-62aa-483d-a7ff-9a932afa8b48 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.976509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723b48f-62aa-483d-a7ff-9a932afa8b48 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:15.977801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 811/1615] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 10:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:15.978860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745a53-afc4-4989-a885-77fa58460fc3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:15.979205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745a53-afc4-4989-a885-77fa58460fc3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:15.979478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f745a53-afc4-4989-a885-77fa58460fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:16.038046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3f745a53-afc4-4989-a885-77fa58460fc3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:16.040532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3f745a53-afc4-4989-a885-77fa58460fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:16.064375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 812/1616] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:16.064375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:16.064375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:16.064375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:16.097512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 805/1617] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:16.111827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:16.122021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38e00-b779-4896-a061-d119cf9197e3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:16.133994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:16.134642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:16.134958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:16.135228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:16.148633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:16.150366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:16.158960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:16.161148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:16.172522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:16.187317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 806/1618] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:16.188079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:16.312765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafebb7-fd49-4ff7-a50d-e17209b18cf1 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:16.317440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177029c-5ef7-4fb1-a469-3ffa3b252b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:16.318070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177029c-5ef7-4fb1-a469-3ffa3b252b5a service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:16.318349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177029c-5ef7-4fb1-a469-3ffa3b252b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:16.318739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177029c-5ef7-4fb1-a469-3ffa3b252b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:16.328538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 813/1619] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:16.328733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177029c-5ef7-4fb1-a469-3ffa3b252b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:16.329587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:16.330377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177029c-5ef7-4fb1-a469-3ffa3b252b5a service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:16.348226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd43-0362-4347-b1c8-3b6265af6359 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:16.349114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 807/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:16.459178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74312f-3e7e-45af-86fa-9feab64e43db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:16.459178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74312f-3e7e-45af-86fa-9feab64e43db service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:16.459178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74312f-3e7e-45af-86fa-9feab64e43db service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:16.459178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74312f-3e7e-45af-86fa-9feab64e43db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:16.526730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74312f-3e7e-45af-86fa-9feab64e43db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:16.529155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74312f-3e7e-45af-86fa-9feab64e43db service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:16.552805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 814/1621] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:17.246494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef6267-b0a3-46b1-8175-0869f1cb01bc None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.247161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef6267-b0a3-46b1-8175-0869f1cb01bc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.248010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef6267-b0a3-46b1-8175-0869f1cb01bc None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.250124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 808/1622] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 10:47:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:47:17.260532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257bbb-8cf2-4d49-a0d4-726bbd899168 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.261135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257bbb-8cf2-4d49-a0d4-726bbd899168 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.261451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb257bbb-8cf2-4d49-a0d4-726bbd899168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.327746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-bb257bbb-8cf2-4d49-a0d4-726bbd899168 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:17.329185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bb257bbb-8cf2-4d49-a0d4-726bbd899168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:17.371798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 815/1623] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 10:47:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:17.379450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1102-cec5-4c0c-83ea-b959c5beabb3 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.379878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1102-cec5-4c0c-83ea-b959c5beabb3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.380326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe1102-cec5-4c0c-83ea-b959c5beabb3 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.382596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 809/1624] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 10:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:17.389477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22754a1d-2e5a-4a20-9867-e10f83d1267a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.390374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22754a1d-2e5a-4a20-9867-e10f83d1267a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.390893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22754a1d-2e5a-4a20-9867-e10f83d1267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.431824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-22754a1d-2e5a-4a20-9867-e10f83d1267a None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:17.436823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-22754a1d-2e5a-4a20-9867-e10f83d1267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:17.474058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 816/1625] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:47:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:17.489091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe1102-cec5-4c0c-83ea-b959c5beabb3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:17.508061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe1102-cec5-4c0c-83ea-b959c5beabb3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:17.522295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468a476-f5df-42b6-b7f7-61fed745c30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:17.523052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468a476-f5df-42b6-b7f7-61fed745c30b service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.523394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468a476-f5df-42b6-b7f7-61fed745c30b service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.523912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468a476-f5df-42b6-b7f7-61fed745c30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.553893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468a476-f5df-42b6-b7f7-61fed745c30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:17.557849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468a476-f5df-42b6-b7f7-61fed745c30b service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:17.602668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 810/1626] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:17.772058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fff78-74d2-400e-9949-3f84c06c66c1 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.773634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fff78-74d2-400e-9949-3f84c06c66c1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.774051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fff78-74d2-400e-9949-3f84c06c66c1 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.776276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 817/1627] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 10:47:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:17.782077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.782589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.783158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.861672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:17.864697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:17.890089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 811/1628] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:47:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:17.903961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fff78-74d2-400e-9949-3f84c06c66c1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:17.916134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fff78-74d2-400e-9949-3f84c06c66c1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:17.920391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07be0-2b84-43a7-97f4-0370ef571c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:17.921361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07be0-2b84-43a7-97f4-0370ef571c8d service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:17.921854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07be0-2b84-43a7-97f4-0370ef571c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:17.922365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07be0-2b84-43a7-97f4-0370ef571c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:17.934259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07be0-2b84-43a7-97f4-0370ef571c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:17.936127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07be0-2b84-43a7-97f4-0370ef571c8d service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:17.964115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 818/1629] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:18.085583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:18.097907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fb297-77d3-4f95-b876-d368d4a38db3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:18.105018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:18.106041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:18.106665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:18.107024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] PATH_INFO: `/v3/users/860f9ea0d73f4f9280796a8e83c2faa1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:18.109217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=860f9ea0d73f4f9280796a8e83c2faa1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:18.111114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: WARNING py.warnings [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:47:18.111114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: warnings.warn(msg) Aug 12 10:47:18.111114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: Aug 12 10:47:18.112754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:18.208706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '860f9ea0d73f4f9280796a8e83c2faa1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:18.212953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:18.224127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '860f9ea0d73f4f9280796a8e83c2faa1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:18.243664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '860f9ea0d73f4f9280796a8e83c2faa1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:18.244338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '860f9ea0d73f4f9280796a8e83c2faa1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:18.285591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '860f9ea0d73f4f9280796a8e83c2faa1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:18.302994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 812/1630] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:18 2022] DELETE /identity/v3/users/860f9ea0d73f4f9280796a8e83c2faa1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:18.307924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ffef-2b09-47d1-957e-32fe77f9f416 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:18.309266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ffef-2b09-47d1-957e-32fe77f9f416 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:18.309803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352ffef-2b09-47d1-957e-32fe77f9f416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:18.342033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c352ffef-2b09-47d1-957e-32fe77f9f416 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:18.344159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c352ffef-2b09-47d1-957e-32fe77f9f416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:18.550134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 819/1631] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:18.645108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:18.647775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:18.810061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5df12d-67f6-484c-95fe-359a67709bd0 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:18.818343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:18.819511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:18.819802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:18.820081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:18.840466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:18.844090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:18.875373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 813/1632] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:19.324834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:19.325410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:19.326218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:19.400688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] MFA Rules not processed for user `1b28ab6da436403985602aadb3f24b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:19.404933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:19.432625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:19.525207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 820/1633] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:19.530134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:19.532562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:19.580336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40152f7-2a43-43ef-9721-19480dd445e6 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:19.593339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:19.594219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:19.598889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:19.600913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:19.604344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:19.611185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:19.699712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 814/1634] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:19 2022] POST /identity/v3/projects => generated 405 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:19.703791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:19.723577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4784a-49b9-4d85-bedc-9f7fb336b1fc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:19.884773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:19.885650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:19.885991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:19.886265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:19.887158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:19.889292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:19.931698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 821/1635] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:19 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:19.933491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:19.948669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0d305-c4bb-4fcd-99b2-c9917e516e62 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:19.953540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:19.954398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:19.954900 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:19.955371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:19.956315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:19.958147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:19.978949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 815/1636] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:19.980083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:19.994491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5a1f5-63fa-4fc1-8386-b1f7ad92e345 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:20.053256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:20.053256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:20.053256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:20.053256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] PATH_INFO: `/v3/projects/f663ce6f4f7045049756dad535c29224/users/4250fa130529465ea8cc789864759a3a/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:20.053963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f663ce6f4f7045049756dad535c29224, user_id=4250fa130529465ea8cc789864759a3a, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:20.053963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:20.072289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 822/1637] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:19 2022] PUT /identity/v3/projects/f663ce6f4f7045049756dad535c29224/users/4250fa130529465ea8cc789864759a3a/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:47:20.073883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:20.088808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e0c9a-cd09-4789-a02d-f653ece81e2f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:20.235020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:20.235677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:20.235951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:20.236221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:20.237259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:20.239034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:20.265266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 816/1638] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:20.269609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:20.285428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165292ee-cce9-4498-9deb-6272ca2d92aa admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:20.294556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798baf8-c190-4c9b-8bfb-c22d85858f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:20.295355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798baf8-c190-4c9b-8bfb-c22d85858f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:20.295701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798baf8-c190-4c9b-8bfb-c22d85858f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:20.296035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798baf8-c190-4c9b-8bfb-c22d85858f04 admin admin] PATH_INFO: `/v3/projects/f663ce6f4f7045049756dad535c29224/users/4250fa130529465ea8cc789864759a3a/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:20.298043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798baf8-c190-4c9b-8bfb-c22d85858f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f663ce6f4f7045049756dad535c29224, user_id=4250fa130529465ea8cc789864759a3a, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:20.312602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798baf8-c190-4c9b-8bfb-c22d85858f04 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:20.329755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 823/1639] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:20 2022] PUT /identity/v3/projects/f663ce6f4f7045049756dad535c29224/users/4250fa130529465ea8cc789864759a3a/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:21.903185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:21.906093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:21.937790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9e680-b835-4eb7-9611-7e5840aebd47 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:22.021305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:22.081915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:22.082709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:22.083000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:22.083298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] PATH_INFO: `/v3/projects/8a1facfcc24741f3ac8c9dc2b7f7defa` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:22.085117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1facfcc24741f3ac8c9dc2b7f7defa)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:22.087178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:22.153661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1facfcc24741f3ac8c9dc2b7f7defa', 'request_id': 'req-9e5904a1-3582-4c0e-9325-068af590a645'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:22.160685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1facfcc24741f3ac8c9dc2b7f7defa', 'request_id': 'req-9e5904a1-3582-4c0e-9325-068af590a645'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:22.168939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1facfcc24741f3ac8c9dc2b7f7defa', 'request_id': 'req-9e5904a1-3582-4c0e-9325-068af590a645'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:22.187036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] The token cache is being invalidate because project 8a1facfcc24741f3ac8c9dc2b7f7defa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:22.187489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:22.188336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-9e5904a1-3582-4c0e-9325-068af590a645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:22.190725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 817/1640] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:21 2022] DELETE /identity/v3/projects/8a1facfcc24741f3ac8c9dc2b7f7defa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:22.195707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:22.196241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:22.196241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:22.234409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:22.238300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:22.380822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 824/1641] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:22.389236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:22.389592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:22.389951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:22.418748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:22.422127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:22.435866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 818/1642] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:22.439155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:22.461959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:22.479367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a9afe-1c49-4543-9c21-e652648f76fd None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:22.491562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:22.492417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:22.492854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:22.493310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:22.494101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:22.494745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:22.502497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:22.529830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:22.543256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 825/1643] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:22.544939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7370ee-72ac-4ac4-9d19-4050d5221a8e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:22.605267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:22.608202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:22.609279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:22.610477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:22.620096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:22.634931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:22.750558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 819/1644] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:22 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:47:22.755159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:22.776459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d578555-3eb5-4173-9e40-6f8f7ee07452 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:22.921027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:22.921027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:22.921027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:22.921027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:22.921272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:22.922055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:22.958889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 826/1645] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:22 2022] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:47:22.963029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:22.998844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce24c9-0c00-42cf-a066-94cfd420d66f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:23.005694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:23.007398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:23.007742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:23.008717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:23.009941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:23.012134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:23.039357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 820/1646] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:23.046136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:23.063119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e20996-5918-4e97-986d-ff021865003e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:23.074855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a17a97-cbc8-4d5b-b56f-ce6b43418946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:23.078613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17a97-cbc8-4d5b-b56f-ce6b43418946 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:23.084711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17a97-cbc8-4d5b-b56f-ce6b43418946 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:23.085417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a17a97-cbc8-4d5b-b56f-ce6b43418946 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:23.086301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17a97-cbc8-4d5b-b56f-ce6b43418946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:23.093472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a17a97-cbc8-4d5b-b56f-ce6b43418946 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:23.156194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 827/1647] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:23.160975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:23.194076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec16faf-b2ed-4734-b59a-7d545ccdc623 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:23.216669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:23.217440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:23.217871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:23.217958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] PATH_INFO: `/v3/projects/ac396b1d4f6646fd8c2bbbfe93b05af2/users/9617dd9a487646edaf864c7ea6f50b00/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:23.262326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac396b1d4f6646fd8c2bbbfe93b05af2, user_id=9617dd9a487646edaf864c7ea6f50b00, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:23.265237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:23.317290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 821/1648] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:23 2022] PUT /identity/v3/projects/ac396b1d4f6646fd8c2bbbfe93b05af2/users/9617dd9a487646edaf864c7ea6f50b00/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:23.329043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:23.329571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:23.329740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:23.414940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] MFA Rules not processed for user `9617dd9a487646edaf864c7ea6f50b00`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:23.416610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:23.600257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 828/1649] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:23.606320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:23.860109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ad29-de3c-4c8e-9674-a4c7667bbeff admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:23.876109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:23.877293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:23.877785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:23.881069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:23.881748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:23.887019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:23.906842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:23.991783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 822/1650] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:23 2022] POST /identity/v3/projects => generated 371 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:23.994824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:24.015684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fa4bf-3ecf-4623-9c5f-429ff3964340 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:24.215200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:24.216625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.216970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.217245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:24.217920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:24.219998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:24.233175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:24.265307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 829/1651] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:23 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:24.270796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:24.291875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d55661-8dee-4c91-8741-d48a5fd660b5 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:24.321469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:24.322127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.322409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.322753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:24.323455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:24.325116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:24.374784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:24.383583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 823/1652] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:24.394122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405b1cc-1a1d-4f4a-bb95-b78d87e14d31 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:24.415492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6faf65-7e90-427c-a681-fb4012d6a834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:24.416423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6faf65-7e90-427c-a681-fb4012d6a834 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.416802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6faf65-7e90-427c-a681-fb4012d6a834 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.417080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6faf65-7e90-427c-a681-fb4012d6a834 admin admin] PATH_INFO: `/v3/projects/6ae71201fe264387b15d620d7406ce81/users/09d67bcee30d4fcd8baf945b1c9ebd84/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:24.453876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6faf65-7e90-427c-a681-fb4012d6a834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae71201fe264387b15d620d7406ce81, user_id=09d67bcee30d4fcd8baf945b1c9ebd84, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:24.457224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6faf65-7e90-427c-a681-fb4012d6a834 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:24.486134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 830/1653] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:24 2022] PUT /identity/v3/projects/6ae71201fe264387b15d620d7406ce81/users/09d67bcee30d4fcd8baf945b1c9ebd84/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:24.487517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:24.508446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb482c9-c8de-4599-89c0-5c56bd8ff58e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:24.547918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335c5b5-6221-4128-9794-1bc4e010faaa None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.548797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335c5b5-6221-4128-9794-1bc4e010faaa None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.549172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335c5b5-6221-4128-9794-1bc4e010faaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:24.673680 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-4335c5b5-6221-4128-9794-1bc4e010faaa None None] MFA Rules not processed for user `4250fa130529465ea8cc789864759a3a`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:24.675884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4335c5b5-6221-4128-9794-1bc4e010faaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:24.783734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:24.785735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.786029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.786306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:24.790547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:24.794030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:24.832038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 824/1654] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:24.834915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:24.883629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e52b1-d927-43e4-8a05-a20f0bfd4a3b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:24.900514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:24.903890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.904304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.905022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] PATH_INFO: `/v3/projects/6ae71201fe264387b15d620d7406ce81/users/09d67bcee30d4fcd8baf945b1c9ebd84/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:24.909497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae71201fe264387b15d620d7406ce81, user_id=09d67bcee30d4fcd8baf945b1c9ebd84, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:24.918025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:24.955303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 831/1655] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:24.970651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 825/1656] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:24 2022] PUT /identity/v3/projects/6ae71201fe264387b15d620d7406ce81/users/09d67bcee30d4fcd8baf945b1c9ebd84/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:24.976921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:24.977209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:24.977488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:25.035663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] MFA Rules not processed for user `09d67bcee30d4fcd8baf945b1c9ebd84`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:25.037080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:25.251992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 832/1657] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:25.265341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:25.267182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:25.421119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f1f8-dc54-44ca-859b-7f9c4f366e9e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:25.428137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d25e7-ba2b-4083-9342-79f6c4bea331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:25.428866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d25e7-ba2b-4083-9342-79f6c4bea331 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:25.429249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d25e7-ba2b-4083-9342-79f6c4bea331 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:25.429728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d25e7-ba2b-4083-9342-79f6c4bea331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:25.465645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d25e7-ba2b-4083-9342-79f6c4bea331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:25.469554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d25e7-ba2b-4083-9342-79f6c4bea331 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:25.500316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 826/1658] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:26.398571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:26.490300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:26.552072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415f73a-80c0-4e58-9e67-cf9657ba2a81 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:26.574385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:26.575300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:26.575709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:26.576247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] PATH_INFO: `/v3/users/9617dd9a487646edaf864c7ea6f50b00` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:26.577853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9617dd9a487646edaf864c7ea6f50b00)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:26.582283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:26.687886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9617dd9a487646edaf864c7ea6f50b00'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:26.696593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9617dd9a487646edaf864c7ea6f50b00'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:26.713540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9617dd9a487646edaf864c7ea6f50b00'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:26.714847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9617dd9a487646edaf864c7ea6f50b00'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:26.736393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9617dd9a487646edaf864c7ea6f50b00'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:26.773620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 833/1659] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:26 2022] DELETE /identity/v3/users/9617dd9a487646edaf864c7ea6f50b00 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:26.775387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4118dd-268d-4e1c-83a7-25b2560475e8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:26.775929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4118dd-268d-4e1c-83a7-25b2560475e8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:26.776194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4118dd-268d-4e1c-83a7-25b2560475e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:26.808334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4b4118dd-268d-4e1c-83a7-25b2560475e8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:26.809569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4b4118dd-268d-4e1c-83a7-25b2560475e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:26.930158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:26.938605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 827/1660] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:26.964762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:26.968580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:27.040161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f752c9-9635-4d65-b7ea-543f534a8d11 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:27.044407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b7825-134d-4137-83fc-2a3d94570f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:27.045087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7825-134d-4137-83fc-2a3d94570f22 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:27.045370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7825-134d-4137-83fc-2a3d94570f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:27.045640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b7825-134d-4137-83fc-2a3d94570f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:27.057443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7825-134d-4137-83fc-2a3d94570f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:27.058945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b7825-134d-4137-83fc-2a3d94570f22 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:27.072825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 834/1661] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:27.433131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da032-5b3d-4fcd-93f0-e1af5c979b09 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:27.433802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da032-5b3d-4fcd-93f0-e1af5c979b09 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:27.434250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270da032-5b3d-4fcd-93f0-e1af5c979b09 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:27.436398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 828/1662] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:47:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:27.454720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd115-06be-4f37-a5bf-e7b2d3d06785 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:27.455133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd115-06be-4f37-a5bf-e7b2d3d06785 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:27.455133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fd115-06be-4f37-a5bf-e7b2d3d06785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:27.499908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-423fd115-06be-4f37-a5bf-e7b2d3d06785 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:27.501148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-423fd115-06be-4f37-a5bf-e7b2d3d06785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:27.696222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:27.722903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460aa3f-0581-4634-921e-154fc1baa34d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:27.723997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460aa3f-0581-4634-921e-154fc1baa34d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:27.724425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460aa3f-0581-4634-921e-154fc1baa34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:27.759954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 835/1663] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:27.789274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c460aa3f-0581-4634-921e-154fc1baa34d None None] MFA Rules not processed for user `763b11870ee642c5b4adc5a1cfd879f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:27.791793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c460aa3f-0581-4634-921e-154fc1baa34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:27.852621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05201-4d3c-4089-841e-2983470a856f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:27.852910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05201-4d3c-4089-841e-2983470a856f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:27.853184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c05201-4d3c-4089-841e-2983470a856f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:27.856184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 836/1664] 10.222.0.26 () {54 vars in 961 bytes} [Fri Aug 12 10:47:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:27.862664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:27.862946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:27.863222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:27.908514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:27.909845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:27.934271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 837/1665] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Aug 12 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:27.943249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:27.978647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721aa38-a747-43fd-97c6-6fd0df2d0b10 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:28.009265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:28.009938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:28.010292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:28.010572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:28.028854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 829/1666] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:28.031153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:28.031447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:28.031724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:28.042562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:28.048121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:28.076422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] MFA Rules not processed for user `763b11870ee642c5b4adc5a1cfd879f8`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:28.081819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:28.093104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 838/1667] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:28.098857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 830/1668] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:28.111932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:28.113465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:28.277066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441cfa8-7c78-4a6a-bfb5-bf7f46daf19c service placement] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:28.293736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97f514-e6e0-43dd-97ef-f470b3a6be26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:28.293736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f514-e6e0-43dd-97ef-f470b3a6be26 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:28.293736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f514-e6e0-43dd-97ef-f470b3a6be26 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:28.294051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97f514-e6e0-43dd-97ef-f470b3a6be26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:28.311867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97f514-e6e0-43dd-97ef-f470b3a6be26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:28.313548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97f514-e6e0-43dd-97ef-f470b3a6be26 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:28.333023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 839/1669] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:28.961320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:28.964637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:28.997164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dec452-cf4d-47e6-857c-62014678957a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:29.008648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:29.010015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.010855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.011341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] PATH_INFO: `/v3/users/91e83090d7464a16a5b737c3bb4fb94b` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.014145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e83090d7464a16a5b737c3bb4fb94b)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:29.021446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:29.126709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42941f8a-38c8-41da-bffa-2b5c418e1138 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.127100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42941f8a-38c8-41da-bffa-2b5c418e1138 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.127340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42941f8a-38c8-41da-bffa-2b5c418e1138 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.129049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 840/1670] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 10:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:29.134292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.134581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.134917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.166104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e83090d7464a16a5b737c3bb4fb94b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.188741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e83090d7464a16a5b737c3bb4fb94b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.203071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e83090d7464a16a5b737c3bb4fb94b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.208713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e83090d7464a16a5b737c3bb4fb94b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.232937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:29.235301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:29.243847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80947b62-1695-4f75-b265-fd8cedad67e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e83090d7464a16a5b737c3bb4fb94b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.253734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 831/1671] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:28 2022] DELETE /identity/v3/users/91e83090d7464a16a5b737c3bb4fb94b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:29.258343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.258702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.258925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.271662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 841/1672] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:29.298933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:29.302384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:29.303456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:29.305264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:29.328852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904b956-73e7-4dde-b0b7-2083e1f23064 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:29.425212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:29.427560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:29.428213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.428511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.428800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.450204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:29.451814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:29.457504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 832/1673] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:29.465832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 842/1674] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:29.480573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:29.482293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:29.495556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650c0e6-8325-4601-a405-291fa6f06741 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:29.499510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:29.500256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.500640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.501013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.512758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:29.514646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:29.519744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:29.521356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:29.550081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30f8f4-6c4e-4f2b-b6d2-0a4ef238b25a service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:29.551223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 833/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:29.556167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:29.557055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.557571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.557992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] PATH_INFO: `/v3/projects/ac396b1d4f6646fd8c2bbbfe93b05af2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.559370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac396b1d4f6646fd8c2bbbfe93b05af2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:29.560522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: WARNING py.warnings [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:47:29.560522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: warnings.warn(msg) Aug 12 10:47:29.560522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: Aug 12 10:47:29.562737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:29.641021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:29.669265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac396b1d4f6646fd8c2bbbfe93b05af2', 'request_id': 'req-8f85c112-23c6-4eac-b83d-07f8f60d1c97'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.678045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac396b1d4f6646fd8c2bbbfe93b05af2', 'request_id': 'req-8f85c112-23c6-4eac-b83d-07f8f60d1c97'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.696039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac396b1d4f6646fd8c2bbbfe93b05af2', 'request_id': 'req-8f85c112-23c6-4eac-b83d-07f8f60d1c97'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.722655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] The token cache is being invalidate because project ac396b1d4f6646fd8c2bbbfe93b05af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:29.723055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.724060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.730378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:29.731921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 843/1676] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:29 2022] DELETE /identity/v3/projects/ac396b1d4f6646fd8c2bbbfe93b05af2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:29.750546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3654141-85e0-4818-9344-22f23fffa974 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:29.857141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:29.858194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:29.859150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:29.861568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] PATH_INFO: `/v3/users/09d67bcee30d4fcd8baf945b1c9ebd84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:29.863425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d67bcee30d4fcd8baf945b1c9ebd84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:29.866971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:29.973709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d67bcee30d4fcd8baf945b1c9ebd84'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:29.991186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d67bcee30d4fcd8baf945b1c9ebd84'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.008357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d67bcee30d4fcd8baf945b1c9ebd84'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.009382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d67bcee30d4fcd8baf945b1c9ebd84'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.026745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d67bcee30d4fcd8baf945b1c9ebd84'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.037449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 834/1677] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:29 2022] DELETE /identity/v3/users/09d67bcee30d4fcd8baf945b1c9ebd84 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:30.331139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:30.331139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:30.355034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c112-23c6-4eac-b83d-07f8f60d1c97 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:30.452729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:30.453478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:30.453757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:30.454118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] PATH_INFO: `/v3/users/1b28ab6da436403985602aadb3f24b3c` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:30.455810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b28ab6da436403985602aadb3f24b3c)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:30.460889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:30.541778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:30.544185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:30.578790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1dc9f-5c71-4ee6-8b3f-810a43fe0bf0 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:30.602337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:30.608129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:30.608621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:30.609079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] PATH_INFO: `/v3/projects/caeb3c42802d428c9421b0f51af1e351` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:30.611003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caeb3c42802d428c9421b0f51af1e351)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:30.613175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:30.616361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b28ab6da436403985602aadb3f24b3c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.633787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b28ab6da436403985602aadb3f24b3c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.675772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b28ab6da436403985602aadb3f24b3c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.677182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b28ab6da436403985602aadb3f24b3c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.700302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6a002379-909d-406a-bf26-89af4eda7ca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b28ab6da436403985602aadb3f24b3c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.721323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 844/1678] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:30 2022] DELETE /identity/v3/users/1b28ab6da436403985602aadb3f24b3c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:30.756841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caeb3c42802d428c9421b0f51af1e351', 'request_id': 'req-5e23f883-ee6c-4959-99c3-998f737f4a22'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.775978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:30.780610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caeb3c42802d428c9421b0f51af1e351', 'request_id': 'req-5e23f883-ee6c-4959-99c3-998f737f4a22'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.820440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caeb3c42802d428c9421b0f51af1e351', 'request_id': 'req-5e23f883-ee6c-4959-99c3-998f737f4a22'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.854318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] The token cache is being invalidate because project caeb3c42802d428c9421b0f51af1e351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:30.854669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.855535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5e23f883-ee6c-4959-99c3-998f737f4a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:30.867205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 835/1679] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:30 2022] DELETE /identity/v3/projects/caeb3c42802d428c9421b0f51af1e351 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:30.872744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:30.873888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:30.874425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:30.927115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:30.941020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:31.089398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:31.152414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 845/1680] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:31.153353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.153793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.153927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.199919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:31.201188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:31.241705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 836/1681] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:31.251217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.270769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a024ad-35f5-4e8e-adf6-6c1e780b87a7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.300909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.310511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.310824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.311103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.311788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:31.312097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.313720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.358987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 846/1682] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:31.363530 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.378358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c82db-4262-4297-9ad8-c73fac007de9 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.400924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.401588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.401870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.402141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.402820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.415760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.479141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.480910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:31.486236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 837/1683] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:31 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:31.493588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.634645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27785733-2450-4382-8df9-4a1b25492d05 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.651367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.652628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.652924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.653190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.654041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.658755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.663210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af5f06-a8f9-4f05-bc8a-bd8d7f9c1b87 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.700444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 838/1684] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:31 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:31.704206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.716325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc398e37-1ae3-4d5f-bf37-4afff8848862 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.728318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.729296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.729775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.730216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.731089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.736390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.766164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 839/1685] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:31.770451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.793795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7811f-1d5f-4171-a09f-1cf3f71c0dfb admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.806089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.808152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.808309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.808573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.808825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b26493-bc04-4559-9883-347e6921036d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.809804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26493-bc04-4559-9883-347e6921036d service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.810275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26493-bc04-4559-9883-347e6921036d service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.810441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.810872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26493-bc04-4559-9883-347e6921036d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.813462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.814403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-50b26493-bc04-4559-9883-347e6921036d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:31.838730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b26493-bc04-4559-9883-347e6921036d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.840857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b26493-bc04-4559-9883-347e6921036d service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.841950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 840/1686] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:31.842921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:31.857217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 847/1687] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:31.874909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d0adb-ab0f-4339-aec1-e0953592dc9f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:31.881567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:31.883214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.883681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.884299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] PATH_INFO: `/v3/projects/b9813cc1c2544b359c9ed1e8a412a25a/users/59260a65d3da49659f14e4c36167741d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:31.936004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9813cc1c2544b359c9ed1e8a412a25a, user_id=59260a65d3da49659f14e4c36167741d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:31.941391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:31.987842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 841/1688] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:31 2022] PUT /identity/v3/projects/b9813cc1c2544b359c9ed1e8a412a25a/users/59260a65d3da49659f14e4c36167741d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:31.990253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:31.990503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:31.990808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:32.059501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] MFA Rules not processed for user `59260a65d3da49659f14e4c36167741d`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:32.063436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:32.169486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:32.199636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 848/1689] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:32.204046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:32.345763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0f3a1-e97e-417c-8583-5c74e4862b6f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:32.351565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:32.352749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:32.353176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:32.353719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:32.354774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:32.357760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:32.364948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:32.404863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 842/1690] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:32 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:32.409728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:32.435409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68cf4a-9f12-4c88-80bb-a993432383bf None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:32.501529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:32.503792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:32.683090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52299f5a-7384-48a0-a1bf-83fa5efd176a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:32.694332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:32.695885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:32.697968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:32.698437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] PATH_INFO: `/v3/projects/6ae71201fe264387b15d620d7406ce81` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:32.700758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae71201fe264387b15d620d7406ce81)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:32.704031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:32.721033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:32.721881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:32.723289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:32.723289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:32.723833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:32.739622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:32.816685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 849/1691] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:32 2022] POST /identity/v3/users => generated 289 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:32.817609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:32.821154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:32.839702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae71201fe264387b15d620d7406ce81', 'request_id': 'req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:32.843131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5b8f-e3e6-446e-9f9e-1f401eb2a5dc admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:32.853433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae71201fe264387b15d620d7406ce81', 'request_id': 'req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:32.869802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae71201fe264387b15d620d7406ce81', 'request_id': 'req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:32.902887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] The token cache is being invalidate because project 6ae71201fe264387b15d620d7406ce81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:32.903466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:32.906067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:32.910579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 843/1692] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:32 2022] DELETE /identity/v3/projects/6ae71201fe264387b15d620d7406ce81 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:47:32.912628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:32.917142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:32.969309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:32.970030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:32.970322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:32.970591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] PATH_INFO: `/v3/projects/e2cb5be6941a4209bce284a6b5dc11b4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:32.976101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cb5be6941a4209bce284a6b5dc11b4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:32.980910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:33.044444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865b7ae-2df4-4ee0-b12d-1394c74cc1cc admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:33.050589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f4cee-e427-4f7a-905c-0bad4232446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:33.051481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4cee-e427-4f7a-905c-0bad4232446d admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.051762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4cee-e427-4f7a-905c-0bad4232446d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.052075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f4cee-e427-4f7a-905c-0bad4232446d admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.052780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f4cee-e427-4f7a-905c-0bad4232446d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:33.054780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f4cee-e427-4f7a-905c-0bad4232446d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:33.083359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 844/1693] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:33.084536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.084820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.085090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.164655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cb5be6941a4209bce284a6b5dc11b4', 'request_id': 'req-79eebebd-8f1b-48f0-8277-75886294835a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.174729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:33.174729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.186701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cb5be6941a4209bce284a6b5dc11b4', 'request_id': 'req-79eebebd-8f1b-48f0-8277-75886294835a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.188315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:33.204432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cb5be6941a4209bce284a6b5dc11b4', 'request_id': 'req-79eebebd-8f1b-48f0-8277-75886294835a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.248639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] The token cache is being invalidate because project e2cb5be6941a4209bce284a6b5dc11b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:33.248955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.249785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.258333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 850/1694] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:32 2022] DELETE /identity/v3/projects/e2cb5be6941a4209bce284a6b5dc11b4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:33.259272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:33.264021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.307991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:33.361216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 845/1695] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:33.362151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:33.366039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.403629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc5bef-9c60-4c2f-904f-78e4d18489f7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:33.414660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:33.415345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.416328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.416645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] PATH_INFO: `/v3/users/4250fa130529465ea8cc789864759a3a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.418629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4250fa130529465ea8cc789864759a3a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:33.421637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:33.448957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eebebd-8f1b-48f0-8277-75886294835a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:33.474516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a7f7b-7222-4a67-b41a-e29e1372860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:33.475271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a7f7b-7222-4a67-b41a-e29e1372860a admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.475553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a7f7b-7222-4a67-b41a-e29e1372860a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.475908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a7f7b-7222-4a67-b41a-e29e1372860a admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.476480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a7f7b-7222-4a67-b41a-e29e1372860a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:33.478131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a7f7b-7222-4a67-b41a-e29e1372860a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:33.496263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 851/1696] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:33.498952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.499404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.499812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.552735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:33.560929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.564662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4250fa130529465ea8cc789864759a3a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.577163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 852/1697] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:33.578266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:33.591710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4250fa130529465ea8cc789864759a3a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.599679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8bfd3-b013-41d4-bd67-8a74c8dd34ee None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:33.606894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4250fa130529465ea8cc789864759a3a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.609277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4250fa130529465ea8cc789864759a3a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.614784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21343aa2-1d08-4623-a2bd-f10b6d499b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:33.615609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343aa2-1d08-4623-a2bd-f10b6d499b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.615972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343aa2-1d08-4623-a2bd-f10b6d499b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.616233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21343aa2-1d08-4623-a2bd-f10b6d499b2f admin admin] PATH_INFO: `/v3/projects/02f5d9c7daec470b9ab27f1d52fc21b7/users/bbb59d046d494c0195ccffc987fcf7b5/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.648886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4250fa130529465ea8cc789864759a3a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:33.655072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21343aa2-1d08-4623-a2bd-f10b6d499b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f5d9c7daec470b9ab27f1d52fc21b7, user_id=bbb59d046d494c0195ccffc987fcf7b5, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:33.661191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21343aa2-1d08-4623-a2bd-f10b6d499b2f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:33.666978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 846/1698] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:33 2022] DELETE /identity/v3/users/4250fa130529465ea8cc789864759a3a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:33.669195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:33.674423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.715150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 853/1699] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:33 2022] PUT /identity/v3/projects/02f5d9c7daec470b9ab27f1d52fc21b7/users/bbb59d046d494c0195ccffc987fcf7b5/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:33.725949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.726225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.726496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.783069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51e1e5-636d-482f-99d8-0acac738c915 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:33.805023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] MFA Rules not processed for user `bbb59d046d494c0195ccffc987fcf7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:33.806252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.851179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:33.889959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:33.890709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.891280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.891552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.892287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:33.893015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:33.894855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf28f57-a722-4b74-b40b-34802f056df2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:33.909598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 847/1700] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:33.911104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:33.911482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:33.911754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:33.960532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] MFA Rules not processed for user `f1921e11db8e45e4af638755cc163823`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:33.962523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:33.977371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 854/1701] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:33.978313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.002342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30f142-9f8b-42bb-a07f-4c175efad556 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.009869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.010553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.010887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.011159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.011806 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.013757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.092571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 848/1702] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:34.094068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.095893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:34.102504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 855/1703] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:33 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:34.107433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.114655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c44f6e-87fd-45ec-92f5-bae0ce13ab54 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.225406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:34.237670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.238670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.239191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.239799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.240689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.244697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.265653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82bec-ef01-4068-ade8-2b4f13645d8d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.277556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.278575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.278575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.278794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.279395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.281365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.288224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 849/1704] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:34 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:34.289578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.291727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:34.328530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 856/1705] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:34 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:34.329443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.346768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb08bf-503d-4455-993c-7aa16597191f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.359009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:34.457132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b335dd-2ad0-4971-9564-9a3c81d967c1 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.468239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc307b6-b7c4-4b2c-b142-9c843f9f3d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.469980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc307b6-b7c4-4b2c-b142-9c843f9f3d96 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.470350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc307b6-b7c4-4b2c-b142-9c843f9f3d96 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.470980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc307b6-b7c4-4b2c-b142-9c843f9f3d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.522398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.522398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.522958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.522958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.523609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.525783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.593024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 857/1706] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:34 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:34.596102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.626872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611842e1-b1fd-4ae7-ab08-2bcc954943b3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.643620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.644663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.646637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.648915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.651618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.658626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.686727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc307b6-b7c4-4b2c-b142-9c843f9f3d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.691531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc307b6-b7c4-4b2c-b142-9c843f9f3d96 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.695311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 858/1707] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:34.696210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:34.716445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:34.734976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 850/1708] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:34.741884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.743107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.743683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.763653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742452e-f0c8-45d7-b3c6-de671bd1fd03 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:34.781767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:34.786185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:34.788106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:34.788680 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] PATH_INFO: `/v3/projects/f663ce6f4f7045049756dad535c29224` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:34.795511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f663ce6f4f7045049756dad535c29224)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:34.799040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:34.849723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] MFA Rules not processed for user `ee081ad8284348af88afe1a8c3dabc97`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:34.855969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:34.977594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f663ce6f4f7045049756dad535c29224', 'request_id': 'req-fbda9093-00f9-4827-ac24-b1e288079afb'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:35.001362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f663ce6f4f7045049756dad535c29224', 'request_id': 'req-fbda9093-00f9-4827-ac24-b1e288079afb'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:35.029709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f663ce6f4f7045049756dad535c29224', 'request_id': 'req-fbda9093-00f9-4827-ac24-b1e288079afb'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:35.110626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] The token cache is being invalidate because project f663ce6f4f7045049756dad535c29224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:35.111193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:35.113468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:35.116567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 859/1709] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:34 2022] DELETE /identity/v3/projects/f663ce6f4f7045049756dad535c29224 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:35.117473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:35.124247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:35.170412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 851/1710] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:35.174957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:35.215403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e695c-b0fd-4f60-b017-38cdf9d64598 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:35.298325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:35.400492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda9093-00f9-4827-ac24-b1e288079afb admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:35.422466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69038269-184f-42be-b0fd-adc08a869fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:35.423159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038269-184f-42be-b0fd-adc08a869fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:35.423443 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038269-184f-42be-b0fd-adc08a869fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:35.423721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69038269-184f-42be-b0fd-adc08a869fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:35.424396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038269-184f-42be-b0fd-adc08a869fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:35.431580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69038269-184f-42be-b0fd-adc08a869fb9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:35.458185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 860/1711] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:35.462777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:35.463303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:35.463904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:35.464614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:35.464897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:35.465003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:35.466427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:35.467850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:35.472196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:35.491658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 852/1712] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:35.491658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:35.495902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:35.544607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:35.567000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:35.568242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:35.578734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 861/1713] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:35.578734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:35.609441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ddcc2-c532-4245-b010-bb8f7d4d38cc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:35.622304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:35.622651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:35.622957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:35.623230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] PATH_INFO: `/v3/projects/27a89fdc623b402ab4c537aeb6cfe5af/users/ec7d7fb105f2412a8bdf56252933bc52/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:35.682173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a89fdc623b402ab4c537aeb6cfe5af, user_id=ec7d7fb105f2412a8bdf56252933bc52, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:35.710884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:35.770734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c476d0-3249-40d3-9c57-eaeafd90f2c7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:35.779874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 862/1714] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:35 2022] PUT /identity/v3/projects/27a89fdc623b402ab4c537aeb6cfe5af/users/ec7d7fb105f2412a8bdf56252933bc52/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:35.780829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:35.792738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:35.944421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:35.945136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:35.945421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:35.945696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:35.955728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:36.078109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d79cc-3a5b-4000-80ec-958cb905dc4f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:36.093609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:36.094307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:36.094600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:36.094876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] PATH_INFO: `/v3/projects/6fdbd3706b074d48b630f60e8e4b8fee/users/c01568bd9ed5457a9bcc122e46e63e6a/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:36.108030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:36.110487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265621a-9241-4fb5-8b2d-0c6344c26eb6 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:36.136575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 853/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:36.153759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4f82b-a9f4-4772-a57b-8d7b48a0042d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:36.156500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4f82b-a9f4-4772-a57b-8d7b48a0042d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:36.156973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4f82b-a9f4-4772-a57b-8d7b48a0042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:36.160422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdbd3706b074d48b630f60e8e4b8fee, user_id=c01568bd9ed5457a9bcc122e46e63e6a, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:36.163301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:36.232364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bbe4f82b-a9f4-4772-a57b-8d7b48a0042d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:36.233138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 863/1716] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:35 2022] PUT /identity/v3/projects/6fdbd3706b074d48b630f60e8e4b8fee/users/c01568bd9ed5457a9bcc122e46e63e6a/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:36.233940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:36.238303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bbe4f82b-a9f4-4772-a57b-8d7b48a0042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:36.352731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:36.476840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 854/1717] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:36.482813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063553-3026-4381-b64c-8e817eef485b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:36.483148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063553-3026-4381-b64c-8e817eef485b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:36.486634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b063553-3026-4381-b64c-8e817eef485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:36.538809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01c621-2dc1-46de-b6db-275896f17c4e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:36.558601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3c5b1-e059-4403-a0f4-052e6aad725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:36.559846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c5b1-e059-4403-a0f4-052e6aad725b admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:36.560040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c5b1-e059-4403-a0f4-052e6aad725b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:36.560267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3c5b1-e059-4403-a0f4-052e6aad725b admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:36.560953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3c5b1-e059-4403-a0f4-052e6aad725b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:36.562644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3c5b1-e059-4403-a0f4-052e6aad725b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:36.563243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5b063553-3026-4381-b64c-8e817eef485b None None] MFA Rules not processed for user `61e3692e4d0e4892abab3d6387fa001f`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:36.564905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5b063553-3026-4381-b64c-8e817eef485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:36.587193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 864/1718] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:36.588691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:36.588977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:36.589250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:36.707056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:36.786124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 855/1719] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:36.787849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:36.788140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:36.788418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:36.792120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:36.796012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:36.847523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] MFA Rules not processed for user `c01568bd9ed5457a9bcc122e46e63e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:36.848847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:36.971798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 865/1720] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:36.972786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:36.996001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 856/1721] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:37.000919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:37.003933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867aeac-ba39-4ad8-9c59-98d7f2897921 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:37.017317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:37.018647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.018647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.019004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.019395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:37.019693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:37.021320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cfa42-48cb-426e-b006-c04782ee2f29 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:37.036566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a2dc2-ac19-4951-aaef-7939f0ad22c8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:37.054228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70be32-ee13-44cc-a6e0-81995fcfd819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:37.054518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 866/1722] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:37.056013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.056229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.056398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70be32-ee13-44cc-a6e0-81995fcfd819 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.056494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.056946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70be32-ee13-44cc-a6e0-81995fcfd819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.057362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70be32-ee13-44cc-a6e0-81995fcfd819 admin admin] PATH_INFO: `/v3/projects/27a89fdc623b402ab4c537aeb6cfe5af/users/ec7d7fb105f2412a8bdf56252933bc52/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.059868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70be32-ee13-44cc-a6e0-81995fcfd819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a89fdc623b402ab4c537aeb6cfe5af, user_id=ec7d7fb105f2412a8bdf56252933bc52, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:37.064506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70be32-ee13-44cc-a6e0-81995fcfd819 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:37.082154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 857/1723] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:36 2022] PUT /identity/v3/projects/27a89fdc623b402ab4c537aeb6cfe5af/users/ec7d7fb105f2412a8bdf56252933bc52/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:37.084683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.085103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.085500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.097776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] MFA Rules not processed for user `61e3692e4d0e4892abab3d6387fa001f`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:37.099070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:37.130295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] MFA Rules not processed for user `afd753e2b6534bfc8f015ab1e9ed939d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:37.132015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:37.185426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:37.215446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 867/1724] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:37.216720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:37.283988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 858/1725] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:37.293578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:37.376098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029d597-aa2a-4def-a840-8fbef6559c31 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:37.382240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ec804-8328-4f29-a227-9496ce3beb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:37.382950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ec804-8328-4f29-a227-9496ce3beb15 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.383276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ec804-8328-4f29-a227-9496ce3beb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.383569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ec804-8328-4f29-a227-9496ce3beb15 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.384385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ec804-8328-4f29-a227-9496ce3beb15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:37.387734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ec804-8328-4f29-a227-9496ce3beb15 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:37.436366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 868/1726] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:37 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:37.439405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.440116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.441848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.491459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:37.493209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a8c0d-dbca-4a48-bd36-3d579b4a8df8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:37.508610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] MFA Rules not processed for user `ec7d7fb105f2412a8bdf56252933bc52`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:37.512403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:37.681993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:37.683100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:37.684916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:37.686929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:37.688710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:37.691406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:37.753490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 869/1727] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:37.758099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:37.794565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 859/1728] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:37 2022] POST /identity/v3/projects => generated 365 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:37.815138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:37.823256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:38.000691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:38.027892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10e611-08b4-4047-8f8d-45597ca544eb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:38.091468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a39c0f-0dcb-48c0-b1f1-5fb657643d47 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:38.102537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:38.103300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.103574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.103906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.259421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:38.261452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:38.278831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 860/1729] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:47:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:47:38.281619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:38.282557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:38.286561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:38.301380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.301883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.302265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.321554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef0b6-6519-4853-97d8-8bbbeee9ba74 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:38.336379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:38.337072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.337337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.337603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.402872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:38.465875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:38.468662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:38.477233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:38.481385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:38.492401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 861/1730] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:38.493283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:38.538891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 870/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:38.549321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:38.554121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:38.696781 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9c17c-02bb-4743-bf51-e9d3ebabbf8e service nova] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:38.711594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:38.712220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.712490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.712764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.713924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:38.718042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:38.780960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 862/1732] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:38 2022] POST /identity/v3/users => generated 287 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:38.783366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:38.802282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca19f3f-5441-46cc-bf7a-776cad9e4852 service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:38.807516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e56b7-08fd-4815-8ac9-99176919ec53 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:38.812202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:38.813328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.814173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.815129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.819330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc67773-96cc-4275-afaa-ae0d33f153a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:38.822915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc67773-96cc-4275-afaa-ae0d33f153a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.823280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc67773-96cc-4275-afaa-ae0d33f153a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.823693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc67773-96cc-4275-afaa-ae0d33f153a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.824433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc67773-96cc-4275-afaa-ae0d33f153a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:38.826623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc67773-96cc-4275-afaa-ae0d33f153a8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:38.866897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:38.884088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 863/1733] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:38 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:38.885363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:38.887066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:38.887479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:38.937138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:38.941732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:39.003510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.011910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:39.047568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 871/1734] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:39.054989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.092689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08840a-9382-4abc-b4c2-5b992c7de002 service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:39.113302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:39.116942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:39.117997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:39.119781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:39.121761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.127744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:39.142980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 864/1735] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Aug 12 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:39.144721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.174010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 872/1736] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:39.187011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.192574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437330-2410-4d7c-8a66-b22ac756ce72 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:39.203168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:39.203815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:39.204097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:39.204361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:39.205314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.208193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814992a-3659-4376-b30f-3fd428ea58f8 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:39.210570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:39.221161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:39.223916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:39.224212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:39.225754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] PATH_INFO: `/v3/projects/c61644fb5a14403e8c1f7c49112224c7/users/9a329551a6664a1eb5ff59d392f59238/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:39.245426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 865/1737] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:39.245426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.245426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:39.265726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61644fb5a14403e8c1f7c49112224c7, user_id=9a329551a6664a1eb5ff59d392f59238, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.270799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:39.276219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8c58e-ec71-4a3d-b26e-b0fdb8465d69 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:39.283521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:39.286263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:39.286263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:39.286263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:39.287977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:39.301559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 873/1738] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:39 2022] PUT /identity/v3/projects/c61644fb5a14403e8c1f7c49112224c7/users/9a329551a6664a1eb5ff59d392f59238/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:39.306278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.317886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:39.545095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.549749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:39.589758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 866/1739] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:39.592155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.618185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:39.662222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb9743-48eb-4440-a12c-13033a1ae865 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:39.665119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7ae4c-bf41-4c03-8449-1679e11f4b38 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:39.679978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:39.683634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:39.683858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:39.685745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:39.733344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.736912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:39.776521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 874/1740] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:39.778041 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:39.918299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:39.919815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:39.920537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:39.921800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:39.923142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:39.928524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:40.017419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 867/1741] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:40.023338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:40.068774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950bc10-28a4-417c-bc7b-f768d7bf66b7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:40.079821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c2a3-3bcc-4e8f-8499-ac568dc7ab42 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:40.093171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db42b-a6f7-4336-8212-ab36099709ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:40.094322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db42b-a6f7-4336-8212-ab36099709ed admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:40.095291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db42b-a6f7-4336-8212-ab36099709ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:40.095944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db42b-a6f7-4336-8212-ab36099709ed admin admin] PATH_INFO: `/v3/projects/1eadcc1be98d4e4fad1f851a73606d36/users/09eaaf74bf5149a58c17cf4edc9dc950/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:40.103429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:40.104182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:40.104462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:40.104737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:40.114069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:40.124746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:40.168605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db42b-a6f7-4336-8212-ab36099709ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eadcc1be98d4e4fad1f851a73606d36, user_id=09eaaf74bf5149a58c17cf4edc9dc950, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:40.175426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db42b-a6f7-4336-8212-ab36099709ed admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:40.184368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 875/1742] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:40.185834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:40.217657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f5cc3-5654-4eb7-bd2c-9bca0c167b64 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:40.251111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 868/1743] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:40 2022] PUT /identity/v3/projects/1eadcc1be98d4e4fad1f851a73606d36/users/09eaaf74bf5149a58c17cf4edc9dc950/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:40.256512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:40.256651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:40.257010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:40.324197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:40.439527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] MFA Rules not processed for user `09eaaf74bf5149a58c17cf4edc9dc950`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:40.441059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:40.514031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d347e-ea3a-44f8-94af-b8cfe38da48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:40.529599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d347e-ea3a-44f8-94af-b8cfe38da48e admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:40.529599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d347e-ea3a-44f8-94af-b8cfe38da48e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:40.529599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d347e-ea3a-44f8-94af-b8cfe38da48e admin admin] PATH_INFO: `/v3/projects/c61644fb5a14403e8c1f7c49112224c7/users/9a329551a6664a1eb5ff59d392f59238/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:40.535124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d347e-ea3a-44f8-94af-b8cfe38da48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61644fb5a14403e8c1f7c49112224c7, user_id=9a329551a6664a1eb5ff59d392f59238, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:40.547238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d347e-ea3a-44f8-94af-b8cfe38da48e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:40.603375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 876/1744] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:40 2022] PUT /identity/v3/projects/c61644fb5a14403e8c1f7c49112224c7/users/9a329551a6664a1eb5ff59d392f59238/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:40.615907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:40.616219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:40.616303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:40.724954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] MFA Rules not processed for user `9a329551a6664a1eb5ff59d392f59238`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:40.734595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:40.746527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 869/1745] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:40.751968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:40.817966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f207c1-e72b-4fbf-98e2-b9f408bd5cdc None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:40.988794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:40.989249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 877/1746] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:40.989495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:40.989789 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:40.990190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:40.990875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:40.992895 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.006718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.017006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:41.054361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 870/1747] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:40 2022] POST /identity/v3/projects => generated 365 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:41.056117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.135794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3f0da-e433-4bc1-bc60-b66e650168a5 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.254482 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.255301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.255589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.255957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.273765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8b48c-a74d-44b9-991c-0fd4098dc356 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.285842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.286573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.286889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.287174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.287817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:41.291088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.335311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 871/1748] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:41 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:47:41.341259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.369471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01ea3e-e523-4ec3-9df4-0871e149f9af admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.381531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.382136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.382421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.382708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.383393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:41.385191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.401492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:41.419173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 872/1749] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:41.420327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.448722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba98f5-b72c-44c7-9a21-9fa4e735d699 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.460400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:41.464930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.467628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.468846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.469281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.469567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] PATH_INFO: `/v3/projects/278001cb8d7e40a3921f66701b530bd6/users/3accd525755a4be29d0269238c2212b1/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.502134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278001cb8d7e40a3921f66701b530bd6, user_id=3accd525755a4be29d0269238c2212b1, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:41.505264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.505529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 878/1750] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:41.529301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 873/1751] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:41 2022] PUT /identity/v3/projects/278001cb8d7e40a3921f66701b530bd6/users/3accd525755a4be29d0269238c2212b1/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:41.533752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.576383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6fb55-1723-4918-b5d0-6fc320e66c5f service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.690435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.813871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.814632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.815042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.815405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.816526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:41.818344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.852721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 879/1752] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:41.854348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:41.879466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d3e7-f885-429d-ba42-8169b5b3a88a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.887060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f715d-b9c4-49b5-b83d-a6fce83213a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.888202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f715d-b9c4-49b5-b83d-a6fce83213a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.888619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f715d-b9c4-49b5-b83d-a6fce83213a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.889318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f715d-b9c4-49b5-b83d-a6fce83213a6 admin admin] PATH_INFO: `/v3/projects/278001cb8d7e40a3921f66701b530bd6/users/3accd525755a4be29d0269238c2212b1/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.891524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f715d-b9c4-49b5-b83d-a6fce83213a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=278001cb8d7e40a3921f66701b530bd6, user_id=3accd525755a4be29d0269238c2212b1, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:41.895609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f715d-b9c4-49b5-b83d-a6fce83213a6 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:41.900930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:41.903364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668c0b-4dcb-419c-920a-cb393cc46152 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:41.912966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:41.914287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.916909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.917258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:41.961650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 880/1753] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:41 2022] PUT /identity/v3/projects/278001cb8d7e40a3921f66701b530bd6/users/3accd525755a4be29d0269238c2212b1/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:41.979104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f8e8e-45de-4092-baae-91935a5024ee None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:41.979104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f8e8e-45de-4092-baae-91935a5024ee None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:41.979104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f8e8e-45de-4092-baae-91935a5024ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:42.072465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-db3f8e8e-45de-4092-baae-91935a5024ee None None] MFA Rules not processed for user `3accd525755a4be29d0269238c2212b1`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:42.074344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-db3f8e8e-45de-4092-baae-91935a5024ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:42.198466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:42.206795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:42.241543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 874/1754] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:42.429350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 881/1755] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:42.461240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:42.476181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5e2e8-49a4-4065-8802-e89d0eff9fce service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:42.585363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d36e-a638-4ceb-a524-03ffebe45166 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:42.587299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d36e-a638-4ceb-a524-03ffebe45166 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:42.587836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8d36e-a638-4ceb-a524-03ffebe45166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:42.613710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a894be5-b03c-44e7-ade3-0fc9ea8c874a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:42.614611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a894be5-b03c-44e7-ade3-0fc9ea8c874a service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:42.615069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a894be5-b03c-44e7-ade3-0fc9ea8c874a service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:42.615638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a894be5-b03c-44e7-ade3-0fc9ea8c874a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:42.633297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a894be5-b03c-44e7-ade3-0fc9ea8c874a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:42.636097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a894be5-b03c-44e7-ade3-0fc9ea8c874a service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:42.678329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 875/1756] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:42.700509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e0b8d36e-a638-4ceb-a524-03ffebe45166 None None] MFA Rules not processed for user `61e3692e4d0e4892abab3d6387fa001f`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:42.710800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e0b8d36e-a638-4ceb-a524-03ffebe45166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:43.027407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 882/1757] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:43.847020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dec5-ce77-47c7-9d51-a2f98609e02f None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:43.848265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dec5-ce77-47c7-9d51-a2f98609e02f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:43.848751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dec5-ce77-47c7-9d51-a2f98609e02f None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:43.851428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 876/1758] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:47:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:43.897632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:43.898202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:43.898202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:43.953292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:43.956147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:44.080633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665257a1-d866-41cc-ba2c-5030ee2e75f0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:44.081166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665257a1-d866-41cc-ba2c-5030ee2e75f0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:44.081675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665257a1-d866-41cc-ba2c-5030ee2e75f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:44.129527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 883/1759] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:44.169149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-665257a1-d866-41cc-ba2c-5030ee2e75f0 None None] MFA Rules not processed for user `f1921e11db8e45e4af638755cc163823`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:44.175309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-665257a1-d866-41cc-ba2c-5030ee2e75f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:44.268699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:44.341834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:44.349793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:44.449997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 877/1760] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:44.550306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1898ae9-0022-4d5d-8a55-31e1c4e18474 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:44.568054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:44.568739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:44.569014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:44.569343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] PATH_INFO: `/v3/users/09eaaf74bf5149a58c17cf4edc9dc950` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:44.573378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] RBAC: Authorizing `identity:delete_user(user_id=09eaaf74bf5149a58c17cf4edc9dc950)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:44.578015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:44.796340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09eaaf74bf5149a58c17cf4edc9dc950'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:44.825902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09eaaf74bf5149a58c17cf4edc9dc950'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:44.836468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09eaaf74bf5149a58c17cf4edc9dc950'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:44.837106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09eaaf74bf5149a58c17cf4edc9dc950'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:44.884343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09eaaf74bf5149a58c17cf4edc9dc950'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:44.909403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 884/1761] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:44 2022] DELETE /identity/v3/users/09eaaf74bf5149a58c17cf4edc9dc950 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:44.911768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:44.912235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:44.912964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:44.985153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:44.990631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:45.063217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:45.064561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:45.275491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84720900-82ee-4a1b-8404-951d4471174e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:45.286745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:45.287753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:45.288949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:45.290566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:45.295566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:45.331294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:45.335460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:45.350117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 878/1762] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:45.352623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:45.356387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:45.386751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 885/1763] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:45.401506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a492dce-6a06-43dc-b0c6-40f5a49517c4 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:45.413433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:45.415516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:45.416572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:45.419071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] PATH_INFO: `/v3/users/59260a65d3da49659f14e4c36167741d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:45.421821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59260a65d3da49659f14e4c36167741d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:45.427353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:45.536887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59260a65d3da49659f14e4c36167741d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:45.557734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59260a65d3da49659f14e4c36167741d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:45.571918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59260a65d3da49659f14e4c36167741d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:45.572710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59260a65d3da49659f14e4c36167741d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:45.635666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa4ef892-34d2-4597-a8b0-08b123ddd362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59260a65d3da49659f14e4c36167741d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:45.655449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:45.656043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 879/1764] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:45 2022] DELETE /identity/v3/users/59260a65d3da49659f14e4c36167741d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:45.657625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:45.661042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe549-7eac-4b71-a9db-386fb51c26fb None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:45.661319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe549-7eac-4b71-a9db-386fb51c26fb None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:45.661709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbe549-7eac-4b71-a9db-386fb51c26fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:45.723147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:45.733943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2ecbe549-7eac-4b71-a9db-386fb51c26fb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:45.740064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2ecbe549-7eac-4b71-a9db-386fb51c26fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:45.850502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:45.851946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ba273-5977-4ece-a3e8-08fc673f3aba service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:45.904729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 880/1765] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:45.942882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511d85-42f9-4299-9761-c94a5ab14cd7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:45.943668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511d85-42f9-4299-9761-c94a5ab14cd7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:45.943668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511d85-42f9-4299-9761-c94a5ab14cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:45.996123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d6511d85-42f9-4299-9761-c94a5ab14cd7 None None] MFA Rules not processed for user `ee081ad8284348af88afe1a8c3dabc97`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:45.999532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d6511d85-42f9-4299-9761-c94a5ab14cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:46.037966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:46.038720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:46.039121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:46.040070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:46.048294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:46.113197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:46.118992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:46.163576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 886/1766] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:46.167281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:46.173079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:46.219535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c732a-8c56-44a3-b159-77fe208f390d service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:46.227247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 881/1767] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:46.235907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcde1f7-b70f-4920-82c5-4325c3d930d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:46.236831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcde1f7-b70f-4920-82c5-4325c3d930d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:46.237189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcde1f7-b70f-4920-82c5-4325c3d930d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:46.237498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcde1f7-b70f-4920-82c5-4325c3d930d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:46.258409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcde1f7-b70f-4920-82c5-4325c3d930d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:46.260413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcde1f7-b70f-4920-82c5-4325c3d930d4 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:46.288363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 887/1768] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:47.524239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2391-df8c-4d32-be04-ffd87e633239 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:47.524874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2391-df8c-4d32-be04-ffd87e633239 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:47.525086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb2391-df8c-4d32-be04-ffd87e633239 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:47.526948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 882/1769] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 10:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:47:47.569127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:47.569645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:47.569922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:47.676893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:47.680447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:47.705989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 888/1770] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:47:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:47.806247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb2391-df8c-4d32-be04-ffd87e633239 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:47.861854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb2391-df8c-4d32-be04-ffd87e633239 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:47.888744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:47.889595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:47.892625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:47.894173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:47.943776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:47.954414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:48.005234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 883/1771] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:49.645085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:49.646879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:49.713194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78304e7d-0559-41d4-b687-71fc35434114 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:49.727629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:49.728399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:49.730032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:49.730862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] PATH_INFO: `/v3/projects/b9813cc1c2544b359c9ed1e8a412a25a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:49.735773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9813cc1c2544b359c9ed1e8a412a25a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:49.738198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:49.880846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9813cc1c2544b359c9ed1e8a412a25a', 'request_id': 'req-7d35d646-af08-4c9a-9ee1-fa0078f9f704'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:49.896150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9813cc1c2544b359c9ed1e8a412a25a', 'request_id': 'req-7d35d646-af08-4c9a-9ee1-fa0078f9f704'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:49.916655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9813cc1c2544b359c9ed1e8a412a25a', 'request_id': 'req-7d35d646-af08-4c9a-9ee1-fa0078f9f704'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:49.956110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:49.958759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:49.991571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] The token cache is being invalidate because project b9813cc1c2544b359c9ed1e8a412a25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:49.993219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:49.998286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:50.009370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0cc88-c20e-4c76-a29b-bddb82abcde8 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:50.015377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 889/1772] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:49 2022] DELETE /identity/v3/projects/b9813cc1c2544b359c9ed1e8a412a25a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:50.020043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:50.024154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:50.199371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:50.201222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:50.206095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:50.207420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] PATH_INFO: `/v3/projects/1eadcc1be98d4e4fad1f851a73606d36` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:50.209515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eadcc1be98d4e4fad1f851a73606d36)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:50.212106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:50.305556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:50.354279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eadcc1be98d4e4fad1f851a73606d36', 'request_id': 'req-b25fc8af-3885-4183-9e8f-5de00e115d96'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:50.383753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eadcc1be98d4e4fad1f851a73606d36', 'request_id': 'req-b25fc8af-3885-4183-9e8f-5de00e115d96'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:50.410540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eadcc1be98d4e4fad1f851a73606d36', 'request_id': 'req-b25fc8af-3885-4183-9e8f-5de00e115d96'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:50.439485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35d646-af08-4c9a-9ee1-fa0078f9f704 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:50.471797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] The token cache is being invalidate because project 1eadcc1be98d4e4fad1f851a73606d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:50.472134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:50.476340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:50.486034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 884/1773] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:49 2022] DELETE /identity/v3/projects/1eadcc1be98d4e4fad1f851a73606d36 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:50.490016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:50.496198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:50.580108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:50.731966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fc8af-3885-4183-9e8f-5de00e115d96 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:50.764207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:50.766903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:50.767201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:50.767476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] PATH_INFO: `/v3/users/3accd525755a4be29d0269238c2212b1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:50.779472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3accd525755a4be29d0269238c2212b1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:50.784736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:50.965572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:50.971882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:50.972323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:50.983244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] PATH_INFO: `/v3/users/bbb59d046d494c0195ccffc987fcf7b5` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:50.998799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb59d046d494c0195ccffc987fcf7b5)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:51.007694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3accd525755a4be29d0269238c2212b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.015719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:51.031841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3accd525755a4be29d0269238c2212b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.090273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3accd525755a4be29d0269238c2212b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.094249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3accd525755a4be29d0269238c2212b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.162107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2c38eb2-7237-434b-b224-5db49ca9187e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3accd525755a4be29d0269238c2212b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.187667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 885/1774] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:50 2022] DELETE /identity/v3/users/3accd525755a4be29d0269238c2212b1 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:51.475949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb59d046d494c0195ccffc987fcf7b5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.502479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb59d046d494c0195ccffc987fcf7b5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.523020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb59d046d494c0195ccffc987fcf7b5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.524246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb59d046d494c0195ccffc987fcf7b5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.548658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb59d046d494c0195ccffc987fcf7b5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:51.572086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 890/1775] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:50 2022] DELETE /identity/v3/users/bbb59d046d494c0195ccffc987fcf7b5 => generated 0 bytes in 1548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:52.948745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54b24-f10e-4718-9c1d-15ae01554978 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:52.949417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54b24-f10e-4718-9c1d-15ae01554978 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:52.949417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e54b24-f10e-4718-9c1d-15ae01554978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:53.002435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f2e54b24-f10e-4718-9c1d-15ae01554978 None None] MFA Rules not processed for user `afd753e2b6534bfc8f015ab1e9ed939d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:53.008237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f2e54b24-f10e-4718-9c1d-15ae01554978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:53.163735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:53.166593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:53.226022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 886/1776] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:53.440927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d344beb-cbfe-4763-98a9-2abe88c1b2a4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:53.457447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:53.458186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:53.458474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:53.458767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] PATH_INFO: `/v3/users/c01568bd9ed5457a9bcc122e46e63e6a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:53.461379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01568bd9ed5457a9bcc122e46e63e6a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:53.464463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:53.489563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:53.621516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01568bd9ed5457a9bcc122e46e63e6a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:53.621516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01568bd9ed5457a9bcc122e46e63e6a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:53.631946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01568bd9ed5457a9bcc122e46e63e6a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:53.642249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01568bd9ed5457a9bcc122e46e63e6a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:53.664736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01568bd9ed5457a9bcc122e46e63e6a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:53.676700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 891/1777] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:53 2022] DELETE /identity/v3/users/c01568bd9ed5457a9bcc122e46e63e6a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:47:53.681874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:53.682561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:53.682561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:53.743942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:53.745366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:53.902637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:54.014749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 887/1778] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:54.169083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:54.171044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:54.303235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76442-48c4-40c2-a418-1ea9e3ffb722 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:54.329281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:54.331496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:54.334006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:54.335394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:54.361134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:54.363102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:54.417688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 892/1779] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:54.926252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:54.928335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:54.946653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445b72b-276f-483c-9a3f-857b9ec8cd23 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:54.955739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:54.958508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:54.959111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:54.959515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] PATH_INFO: `/v3/projects/02f5d9c7daec470b9ab27f1d52fc21b7` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:54.964495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f5d9c7daec470b9ab27f1d52fc21b7)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:54.967008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:55.125190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f5d9c7daec470b9ab27f1d52fc21b7', 'request_id': 'req-c5452d7f-27f2-4240-9d37-7b4110fddf98'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.134314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f5d9c7daec470b9ab27f1d52fc21b7', 'request_id': 'req-c5452d7f-27f2-4240-9d37-7b4110fddf98'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.162723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f5d9c7daec470b9ab27f1d52fc21b7', 'request_id': 'req-c5452d7f-27f2-4240-9d37-7b4110fddf98'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.182295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] The token cache is being invalidate because project 02f5d9c7daec470b9ab27f1d52fc21b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:55.182953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.183873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.189294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 888/1780] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:54 2022] DELETE /identity/v3/projects/02f5d9c7daec470b9ab27f1d52fc21b7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:55.191775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:55.211222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e7ac0-91d8-40ec-ada0-ae8787eecc49 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:55.219250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:55.220804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:55.292029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:55.293336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.293716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.294086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] PATH_INFO: `/v3/users/ec7d7fb105f2412a8bdf56252933bc52` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.295365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec7d7fb105f2412a8bdf56252933bc52)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:55.297442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:55.338449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5452d7f-27f2-4240-9d37-7b4110fddf98 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:55.342711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:55.351108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:55.354864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.355462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.355935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] PATH_INFO: `/v3/projects/278001cb8d7e40a3921f66701b530bd6` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.358400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=278001cb8d7e40a3921f66701b530bd6)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:55.360636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:55.373674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec7d7fb105f2412a8bdf56252933bc52'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.385812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec7d7fb105f2412a8bdf56252933bc52'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.397231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec7d7fb105f2412a8bdf56252933bc52'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.397843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec7d7fb105f2412a8bdf56252933bc52'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.417795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e8fb63b7-503a-4ba6-9aaa-214cb07ae930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec7d7fb105f2412a8bdf56252933bc52'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.424011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '278001cb8d7e40a3921f66701b530bd6', 'request_id': 'req-678b6c5c-b572-45e3-afef-dda8ac5543d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.425708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 893/1781] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:55 2022] DELETE /identity/v3/users/ec7d7fb105f2412a8bdf56252933bc52 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:55.427645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035c1f-e4b3-4cc2-a57f-314e6db36a8e None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.428080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035c1f-e4b3-4cc2-a57f-314e6db36a8e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.428558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4035c1f-e4b3-4cc2-a57f-314e6db36a8e None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.430266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 894/1782] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:55.439847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '278001cb8d7e40a3921f66701b530bd6', 'request_id': 'req-678b6c5c-b572-45e3-afef-dda8ac5543d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.441571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9df92-af7c-4775-8cf8-555c5a37e6ac None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.441846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9df92-af7c-4775-8cf8-555c5a37e6ac None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.442106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9df92-af7c-4775-8cf8-555c5a37e6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.462361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '278001cb8d7e40a3921f66701b530bd6', 'request_id': 'req-678b6c5c-b572-45e3-afef-dda8ac5543d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.465476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:55.476187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9af9df92-af7c-4775-8cf8-555c5a37e6ac None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:55.477436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9af9df92-af7c-4775-8cf8-555c5a37e6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:55.500285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] The token cache is being invalidate because project 278001cb8d7e40a3921f66701b530bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:55.500786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.501611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-678b6c5c-b572-45e3-afef-dda8ac5543d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:55.504744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 889/1783] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:55 2022] DELETE /identity/v3/projects/278001cb8d7e40a3921f66701b530bd6 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:47:55.510665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.511233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.512472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.546591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:55.550369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:55.589568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 895/1784] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:55.626735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 890/1785] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:55.635346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.635626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.635894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.660978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:55.662533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:55.681945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 896/1786] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:55.682918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:55.699708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6272a-22be-4075-be6e-318bc438b58c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:55.709803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:55.711004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.714626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.714993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.715709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:55.716065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:55.717857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:55.735639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 891/1787] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:47:55.738079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:55.749327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c843199-5685-4b64-8240-90230f5c0588 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:55.755112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:55.755808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.756001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:55.756285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:55.757449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:55.759715 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:55.807831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 897/1788] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:55 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:55.808970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:55.821617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:55.829631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4d98e-ed40-4c2c-a80a-2aa654731072 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:55.831094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:55.997319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:55.998359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:55.998651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.000537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.004881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.010079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.028113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfcea-5be5-47cf-8953-e5239ef1a623 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:56.043129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:56.044039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.044520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.045379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.064669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.068361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.075446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 892/1789] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:55 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:47:56.079130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:56.086401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:56.120198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcf258-b623-4003-b135-66129634bb3e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:56.121549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 898/1790] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:56.166566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:56.168007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.168506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.169029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.170137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.173112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.194915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 893/1791] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:56.199577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:56.224741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:56.229660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:56.234875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ae078-c65a-484c-bfea-cab35240b210 service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:56.271897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:56.274081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.275872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.276228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.278352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.281412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.286933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464e2b6-2b25-4946-92fc-20cd21d03bdf admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:56.304151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:56.316185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.316805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.317465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] PATH_INFO: `/v3/projects/27a89fdc623b402ab4c537aeb6cfe5af` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.323588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a89fdc623b402ab4c537aeb6cfe5af)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.333754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 899/1792] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:56.335957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:56.336745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.362422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72deea27-f7eb-4a45-8899-02e6de21d769 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:56.377847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:56.379854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.380307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.380734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] PATH_INFO: `/v3/projects/8ae147c9a5204f85afa4387ec5d3bb6a/users/8a97490dcb49410bb46890fef9c75edc/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.429888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae147c9a5204f85afa4387ec5d3bb6a, user_id=8a97490dcb49410bb46890fef9c75edc, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.437543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.471526 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 900/1793] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:56 2022] PUT /identity/v3/projects/8ae147c9a5204f85afa4387ec5d3bb6a/users/8a97490dcb49410bb46890fef9c75edc/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:56.473850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:56.476153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a89fdc623b402ab4c537aeb6cfe5af', 'request_id': 'req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.478227 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:56.481628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:INSERT=4,keystone:DELETE=6,keystone:SELECT=90 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:56.494253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a89fdc623b402ab4c537aeb6cfe5af', 'request_id': 'req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.513382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a89fdc623b402ab4c537aeb6cfe5af', 'request_id': 'req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.544262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] The token cache is being invalidate because project 27a89fdc623b402ab4c537aeb6cfe5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:56.545665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.552904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3b4c4e2a-e31d-4ff9-84a4-4cafe4540f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.573153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 894/1794] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:56 2022] DELETE /identity/v3/projects/27a89fdc623b402ab4c537aeb6cfe5af => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:56.607187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f589-d7f2-4cc5-a31a-5a2de7ac6f3f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.608468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f589-d7f2-4cc5-a31a-5a2de7ac6f3f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.610153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16f589-d7f2-4cc5-a31a-5a2de7ac6f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.693328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8c16f589-d7f2-4cc5-a31a-5a2de7ac6f3f None None] MFA Rules not processed for user `8a97490dcb49410bb46890fef9c75edc`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:56.694618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8c16f589-d7f2-4cc5-a31a-5a2de7ac6f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:56.718405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6d555-d1c3-481d-9d72-e72163229c3e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:56.731051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:56.733451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.733778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.734056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] PATH_INFO: `/v3/projects/6fdbd3706b074d48b630f60e8e4b8fee` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.737504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdbd3706b074d48b630f60e8e4b8fee)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:56.740676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:56.853593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdbd3706b074d48b630f60e8e4b8fee', 'request_id': 'req-8cac0a7d-ba72-4407-8ab4-1037707ac24b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.865078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 895/1795] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:56.866382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:56.866698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:56.866970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:56.868833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdbd3706b074d48b630f60e8e4b8fee', 'request_id': 'req-8cac0a7d-ba72-4407-8ab4-1037707ac24b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.878734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdbd3706b074d48b630f60e8e4b8fee', 'request_id': 'req-8cac0a7d-ba72-4407-8ab4-1037707ac24b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.897026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] The token cache is being invalidate because project 6fdbd3706b074d48b630f60e8e4b8fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:47:56.897527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.898202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:56.901243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 901/1796] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:47:56 2022] DELETE /identity/v3/projects/6fdbd3706b074d48b630f60e8e4b8fee => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:56.903602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:56.909406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:56.925182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:56.926588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:57.043713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:57.066384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac0a7d-ba72-4407-8ab4-1037707ac24b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.079717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c0234-d0a9-438d-9c6d-52bf1f79211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.080364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c0234-d0a9-438d-9c6d-52bf1f79211c admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.080638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c0234-d0a9-438d-9c6d-52bf1f79211c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.080907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c0234-d0a9-438d-9c6d-52bf1f79211c admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.081550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c0234-d0a9-438d-9c6d-52bf1f79211c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.082171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 896/1797] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:57.083078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.086363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:57.094293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c0234-d0a9-438d-9c6d-52bf1f79211c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.113327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85d22b-3b7f-4f03-8ac0-1414e650ce6f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.126848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.127516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.129994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.130482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] PATH_INFO: `/v3/users/9a329551a6664a1eb5ff59d392f59238` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.133200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a329551a6664a1eb5ff59d392f59238)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.135293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.180694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 902/1798] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:56 2022] POST /identity/v3/projects => generated 369 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:57.182165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.182499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.182797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.261320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a329551a6664a1eb5ff59d392f59238'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:57.264101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:57.265904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:57.298960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a329551a6664a1eb5ff59d392f59238'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:57.316644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a329551a6664a1eb5ff59d392f59238'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:57.323250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a329551a6664a1eb5ff59d392f59238'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:57.325612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:57.347316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a329551a6664a1eb5ff59d392f59238'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:47:57.357750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 897/1799] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:47:57 2022] DELETE /identity/v3/users/9a329551a6664a1eb5ff59d392f59238 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:57.358798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.365728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:57.389478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 903/1800] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:57.394351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.407020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b9325-7ca9-4a83-9b41-f1022b152407 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.511723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24750f07-7932-426a-b4f9-576dd46d3e43 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.532974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.533902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.534325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.534858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.534983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.535772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.535979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.536229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.536629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.537389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:47:57.537786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.538778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.539634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.565571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 904/1801] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:47:57.567240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.576605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 898/1802] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:57 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:57.577864 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.580307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed4c1-3534-4ec5-bcbc-9500d811d5bc admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.588117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.588877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.589292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.589659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.590422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.592830 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.600876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc299e9d-9dde-4cef-8045-d83118573b82 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.615159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.616018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.616485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.616891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.617910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.619977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.637926 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 905/1803] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:57 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:57.639599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.647567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 899/1804] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:57.649929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.674898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547a0d4-bf3d-4578-89c6-0e359d5e653c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.761362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:57.788762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaabcd-1cad-4a5c-a58a-099a43441af8 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.797417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.798082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.798510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.798673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.799377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.801542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.803336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:57.804029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:57.804358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:57.804638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] PATH_INFO: `/v3/projects/8d83c08595804ce6a01fe46281474c9e/users/d7fb277b5a4c4437b16e1aa00d76f5e2/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:57.831333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d83c08595804ce6a01fe46281474c9e, user_id=d7fb277b5a4c4437b16e1aa00d76f5e2, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:57.836296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:57.851704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 906/1805] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:57 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:57.855282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.867090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 900/1806] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:57 2022] PUT /identity/v3/projects/8d83c08595804ce6a01fe46281474c9e/users/d7fb277b5a4c4437b16e1aa00d76f5e2/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:57.871695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:57.877483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2be3f-e7c1-4cdd-8b0a-fe907cb67802 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:57.978140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:58.036850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.037590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.037984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.038402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.039391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.043053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.053675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e20c0d-7004-4b5c-b951-bbbddb12d9de admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.067576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.068354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.068758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.069041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.069831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.071950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.079698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 907/1807] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:47:58.081130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.089141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 901/1808] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:47:58.093484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.094750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd989e04-e0cf-4930-890f-c5b54507bbbf admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.103340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.106146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.106429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.107820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.110169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.110440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0988b2-d458-456c-a070-96fc2da9d6f3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.112861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.115613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382396ae-6391-44fb-8d64-715353791166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.116456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382396ae-6391-44fb-8d64-715353791166 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.116747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382396ae-6391-44fb-8d64-715353791166 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.116993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382396ae-6391-44fb-8d64-715353791166 admin admin] PATH_INFO: `/v3/projects/8d83c08595804ce6a01fe46281474c9e/users/d7fb277b5a4c4437b16e1aa00d76f5e2/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.120397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382396ae-6391-44fb-8d64-715353791166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d83c08595804ce6a01fe46281474c9e, user_id=d7fb277b5a4c4437b16e1aa00d76f5e2, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.121725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382396ae-6391-44fb-8d64-715353791166 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.136195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 902/1809] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:58 2022] PUT /identity/v3/projects/8d83c08595804ce6a01fe46281474c9e/users/d7fb277b5a4c4437b16e1aa00d76f5e2/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:58.147314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.147639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.148173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.174860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 908/1810] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:58.177935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.197707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] MFA Rules not processed for user `d7fb277b5a4c4437b16e1aa00d76f5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:58.199038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:58.204237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe5d7-6702-4df9-9f13-ac6215fa10c9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.353073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc62ebb-a709-4495-9d68-e4987f6e27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.353927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62ebb-a709-4495-9d68-e4987f6e27cf admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.354187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62ebb-a709-4495-9d68-e4987f6e27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.354452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc62ebb-a709-4495-9d68-e4987f6e27cf admin admin] PATH_INFO: `/v3/projects/b3f1b5fe33374c96865654fc82a23e61/users/2e69dd945d4d4f2b8880fccbd628e531/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.361458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 903/1811] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:47:58.375815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.379993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:58.394332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc62ebb-a709-4495-9d68-e4987f6e27cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f1b5fe33374c96865654fc82a23e61, user_id=2e69dd945d4d4f2b8880fccbd628e531, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.397266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc62ebb-a709-4495-9d68-e4987f6e27cf admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.433721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 909/1812] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:58 2022] PUT /identity/v3/projects/b3f1b5fe33374c96865654fc82a23e61/users/2e69dd945d4d4f2b8880fccbd628e531/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:58.438852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.439162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.439440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.457750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9ebd-c391-4ea6-b548-bbddb690c563 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.527225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] MFA Rules not processed for user `2e69dd945d4d4f2b8880fccbd628e531`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:58.532204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:58.584505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.585156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.585427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.585694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.615233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:58.638334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:58.700778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 910/1813] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:58.702298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.721609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.724152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.737401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 904/1814] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:47:58.825317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.828193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:58.841652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571a8bf-6547-4f04-b9e2-f3825db7b5ef service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.842658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08142015-039c-4ac7-b8e0-b82e2f5cebbf None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:58.846723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.847630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.848077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.848747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.849881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:58.850843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:58.851239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:58.851511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:58.851610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:58.852451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.855218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:58.919948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 911/1815] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:47:58 2022] POST /identity/v3/projects => generated 373 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:58.923646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:58.982721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:58.987104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:59.007112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 905/1816] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:47:59.069849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333763b-112c-4d33-80bd-6b93ecbd91b7 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:59.078434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:59.079115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.079403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.079655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.080287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:59.082286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:59.114266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 912/1817] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:47:58 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:47:59.118390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:59.137104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d9bc6-4fc3-4662-81f0-dc95f7699d80 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:59.153143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:59.154094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.154094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.154256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.154903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:59.156557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:59.178567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 906/1818] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:59.183295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:59.199698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ef173-5bc5-4766-a359-e92b6948a108 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:59.205857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:59.207166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.207613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.207986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] PATH_INFO: `/v3/projects/49859f76fb354ec285e9f461616a279a/users/0e893d836e804955876109fcf997dac4/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.227621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=49859f76fb354ec285e9f461616a279a, user_id=0e893d836e804955876109fcf997dac4, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:59.230623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:59.254273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 913/1819] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:59 2022] PUT /identity/v3/projects/49859f76fb354ec285e9f461616a279a/users/0e893d836e804955876109fcf997dac4/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:59.259698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:59.275487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c362a-d594-45f3-9d52-44063110edd1 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:59.366170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881271ec-10fa-4ae4-8266-b2e3d1eb8fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:59.366948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881271ec-10fa-4ae4-8266-b2e3d1eb8fdd admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.367378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881271ec-10fa-4ae4-8266-b2e3d1eb8fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.367672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881271ec-10fa-4ae4-8266-b2e3d1eb8fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.368501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881271ec-10fa-4ae4-8266-b2e3d1eb8fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:59.370743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881271ec-10fa-4ae4-8266-b2e3d1eb8fdd admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:59.385617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 907/1820] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:47:59.389572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:59.415573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dde5a-8111-4d39-9ccd-7ba7f83431cd admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:59.443060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2336e9-a2cb-48e7-9543-5b68c98e82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:59.443060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2336e9-a2cb-48e7-9543-5b68c98e82b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.443060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2336e9-a2cb-48e7-9543-5b68c98e82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.443060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2336e9-a2cb-48e7-9543-5b68c98e82b0 admin admin] PATH_INFO: `/v3/projects/49859f76fb354ec285e9f461616a279a/users/0e893d836e804955876109fcf997dac4/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.449238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2336e9-a2cb-48e7-9543-5b68c98e82b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49859f76fb354ec285e9f461616a279a, user_id=0e893d836e804955876109fcf997dac4, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:47:59.458702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2336e9-a2cb-48e7-9543-5b68c98e82b0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:47:59.499306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 914/1821] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:47:59 2022] PUT /identity/v3/projects/49859f76fb354ec285e9f461616a279a/users/0e893d836e804955876109fcf997dac4/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:47:59.509857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.510174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.510392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.582042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] MFA Rules not processed for user `0e893d836e804955876109fcf997dac4`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:59.584155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:59.669377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd11c8d-2187-4319-b48d-e4e764b67544 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.669825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd11c8d-2187-4319-b48d-e4e764b67544 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.670346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd11c8d-2187-4319-b48d-e4e764b67544 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.674001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:59.674312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 915/1822] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:47:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:47:59.687517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.688106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.688512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.717166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:47:59.718623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:47:59.733145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:47:59.766901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 908/1823] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:47:59.772947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:47:59.857627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41196b84-98cb-4fdb-953a-f6563c3c6201 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:47:59.867872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:47:59.869534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:47:59.871109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:47:59.871396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:47:59.884220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 916/1824] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:00.023661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:00.025131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:00.039748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:00.041508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:00.045946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 909/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:47:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:00.143914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70c6e6-7715-46ac-bd76-b3eb37d30b2f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:00.149093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:00.149741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.150037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.150311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] PATH_INFO: `/v3/projects/c61644fb5a14403e8c1f7c49112224c7` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.151652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61644fb5a14403e8c1f7c49112224c7)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:00.153732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:00.180107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:00.187435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:00.219457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c91a-aac5-4eef-980a-b6996bdd6024 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:00.220234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61644fb5a14403e8c1f7c49112224c7', 'request_id': 'req-c632805f-3838-4980-b973-0d3f1c0622e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:00.231631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61644fb5a14403e8c1f7c49112224c7', 'request_id': 'req-c632805f-3838-4980-b973-0d3f1c0622e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:00.239317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61644fb5a14403e8c1f7c49112224c7', 'request_id': 'req-c632805f-3838-4980-b973-0d3f1c0622e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:00.268072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] The token cache is being invalidate because project c61644fb5a14403e8c1f7c49112224c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:00.268619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:00.269507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c632805f-3838-4980-b973-0d3f1c0622e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:00.272958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 917/1826] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:00 2022] DELETE /identity/v3/projects/c61644fb5a14403e8c1f7c49112224c7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:00.278412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.279184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.280104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.376611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:00.383051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:00.405147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:00.408076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.408564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.409077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.413611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:00.450340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:00.453010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da7377-05d9-4afc-ac7b-d71b0068c887 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:00.495006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 910/1827] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:00.498298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:00.610431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.610870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.611351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.616472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 918/1828] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:00.640764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:00.654275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:00.655820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:00.680754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 911/1829] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:00.686009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:00.703314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da8c3b-e9f8-4714-8074-a21bfb8f064f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:00.717295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:00.718613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.719177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.719543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.720594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:00.721014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:00.723095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:00.744628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:00.754661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 919/1830] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:00.761860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360c80-8430-4085-9f33-ced02e04e712 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:00.770297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:00.771380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.771872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.772251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.773095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:00.776911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:00.828619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:00.828775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 912/1831] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:00 2022] POST /identity/v3/projects => generated 365 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:00.841542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada17da1-f5c2-4066-8c48-de73d8ff2c3f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:00.987782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:00.988462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:00.988743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:00.989013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:00.989757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:00.993935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.035098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.051438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 920/1832] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:00 2022] POST /identity/v3/users => generated 283 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:01.051986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c4302-e856-49c5-825a-2ae2d8d06a3f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.061311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.062587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.063515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.063931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.065307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.067621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.090991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.104396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 913/1833] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:01.107373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3718fb9-3a11-4717-84e0-989eacabeb1f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.114439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee177c-99d5-426f-9505-e644a27595e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.115929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee177c-99d5-426f-9505-e644a27595e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.116359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee177c-99d5-426f-9505-e644a27595e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.116803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee177c-99d5-426f-9505-e644a27595e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.117573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee177c-99d5-426f-9505-e644a27595e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.119467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee177c-99d5-426f-9505-e644a27595e0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.140020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 921/1834] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:01.141788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.154639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11ed14-d6b5-48df-a470-c0e738c86e00 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.162641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.163439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.163721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.164022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] PATH_INFO: `/v3/projects/be31b1e8a7be4d5ebb91821bcb8213ae/users/8cf946d5aac74bd9a45477929ddfe8d3/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.182304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be31b1e8a7be4d5ebb91821bcb8213ae, user_id=8cf946d5aac74bd9a45477929ddfe8d3, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.185272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.220608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.220963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.221195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.224149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 914/1835] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:01 2022] PUT /identity/v3/projects/be31b1e8a7be4d5ebb91821bcb8213ae/users/8cf946d5aac74bd9a45477929ddfe8d3/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:01.259930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] MFA Rules not processed for user `8cf946d5aac74bd9a45477929ddfe8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:01.263336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:01.371070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.377397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 922/1836] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:01.474485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c88c3-8db8-45f0-99c5-689475d08ee2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.479834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.480697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.481070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.481323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.482082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.484377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.523686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.525861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 915/1837] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:01 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:01.537320 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd90f55-66c9-405f-97af-9046c1a43721 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.619342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:01.676901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.677525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.677802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.678067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.678828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.682372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.763577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 923/1838] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:01 2022] POST /identity/v3/users => generated 290 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:01.767322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.779451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4ec9-7758-4296-81ce-ef042175ce4a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.784351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.785274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.785654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.786021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.786917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.788708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.807831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.813756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 916/1839] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:01.820262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10760918-558d-4e01-ae74-c3d531f82231 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.826189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.827940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.828323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.828692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] PATH_INFO: `/v3/projects/748a4414ae8349f0be6d04ee6850c747/users/67486f43f2284475b771bbf672ae9d7e/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.848043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748a4414ae8349f0be6d04ee6850c747, user_id=67486f43f2284475b771bbf672ae9d7e, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.851104 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.876618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.877324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 924/1840] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:01 2022] PUT /identity/v3/projects/748a4414ae8349f0be6d04ee6850c747/users/67486f43f2284475b771bbf672ae9d7e/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:01.889339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895efb56-3379-47f2-90af-3e600d4d8dc4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:01.978407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d693a-29f3-4ac0-8918-953da47d6e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:01.979548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d693a-29f3-4ac0-8918-953da47d6e74 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:01.979548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d693a-29f3-4ac0-8918-953da47d6e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:01.979791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d693a-29f3-4ac0-8918-953da47d6e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:01.980436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d693a-29f3-4ac0-8918-953da47d6e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:01.982116 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d693a-29f3-4ac0-8918-953da47d6e74 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:01.998188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:01.998576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 917/1841] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:02.010645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2a8d3-f2df-4b11-b837-8385ce35bd16 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:02.017693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:02.018890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:02.019265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:02.019536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] PATH_INFO: `/v3/projects/748a4414ae8349f0be6d04ee6850c747/users/67486f43f2284475b771bbf672ae9d7e/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:02.022321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=748a4414ae8349f0be6d04ee6850c747, user_id=67486f43f2284475b771bbf672ae9d7e, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:02.024928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:02.047888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:02.048454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:02.048856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:02.049031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 925/1842] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:01 2022] PUT /identity/v3/projects/748a4414ae8349f0be6d04ee6850c747/users/67486f43f2284475b771bbf672ae9d7e/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:02.083708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:02.093452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] MFA Rules not processed for user `67486f43f2284475b771bbf672ae9d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:02.094787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:02.277304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 918/1843] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:02.294919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:02.297154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:02.363773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd6532-d3c6-45c7-9408-49d9c3acc379 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:02.389916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:02.389916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:02.389916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:02.389916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:02.419147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:02.422145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:02.441384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 926/1844] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:02.542862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:02.553963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceab90f-e25f-436c-9346-fd51be937d73 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:02.557608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:02.558342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:02.558832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:02.559469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:02.636296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:02.639181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:02.651849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 919/1845] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:03.199528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:03.201113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:03.243133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:03.244844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:03.328579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee551b-4f3c-4c35-93e4-4569d1fd5efc service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:03.335302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:03.336202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:03.336389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b28174-0cec-4da5-966d-b2a28e17af18 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:03.336658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:03.337864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] PATH_INFO: `/v3/users/8a97490dcb49410bb46890fef9c75edc` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:03.339669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a97490dcb49410bb46890fef9c75edc)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:03.341830 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:03.342289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:03.343209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:03.343627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:03.344172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] PATH_INFO: `/v3/users/2e69dd945d4d4f2b8880fccbd628e531` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:03.356979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e69dd945d4d4f2b8880fccbd628e531)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:03.360514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:03.435211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:03.468497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:03.478390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a97490dcb49410bb46890fef9c75edc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.492400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e69dd945d4d4f2b8880fccbd628e531'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.500459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a97490dcb49410bb46890fef9c75edc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.507918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e69dd945d4d4f2b8880fccbd628e531'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.519143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a97490dcb49410bb46890fef9c75edc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.519886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a97490dcb49410bb46890fef9c75edc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.523414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e69dd945d4d4f2b8880fccbd628e531'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.525571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e69dd945d4d4f2b8880fccbd628e531'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.545543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-51d91d9f-cf65-4600-8479-e0db352c6a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a97490dcb49410bb46890fef9c75edc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.554351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-57091a3a-b6fd-4cd0-bf42-caf4fb1f5427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e69dd945d4d4f2b8880fccbd628e531'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:03.557103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 927/1846] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:03 2022] DELETE /identity/v3/users/8a97490dcb49410bb46890fef9c75edc => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:03.561404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:03.561812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:03.562155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:03.562587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 920/1847] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:03 2022] DELETE /identity/v3/users/2e69dd945d4d4f2b8880fccbd628e531 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:03.567045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:03.567306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:03.567582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:03.584182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:03.585964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:03.606450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:03.607935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:03.707706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 921/1848] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:03.719763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 928/1849] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:03.724756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:03.732654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:03.735639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:03.740883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:03.806998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a0cf5-8bf4-4576-9c66-32f99245cc11 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:03.810910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:03.811643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:03.812013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:03.812378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:03.823862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:03.825747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:03.829389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18b61e-6aa0-4b39-9619-09e45812fc62 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:03.837822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:03.838468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:03.838770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:03.839200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:03.840248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 922/1850] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:03.851324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:03.853151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:03.864222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 929/1851] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:04.335297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:04.336820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:04.358942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c422223-6b2f-45cd-a5c2-57d2206b4da8 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:04.365234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:04.365578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:04.367869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:04.383831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:04.384870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:04.386082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] PATH_INFO: `/v3/projects/8ae147c9a5204f85afa4387ec5d3bb6a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:04.392048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae147c9a5204f85afa4387ec5d3bb6a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:04.408273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f787347-ff24-4178-a82e-36603a7f0533 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:04.412987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:04.425431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:04.426101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:04.426379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:04.432590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] PATH_INFO: `/v3/projects/b3f1b5fe33374c96865654fc82a23e61` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:04.443354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f1b5fe33374c96865654fc82a23e61)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:04.445318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:04.533466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae147c9a5204f85afa4387ec5d3bb6a', 'request_id': 'req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.539927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:04.542822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae147c9a5204f85afa4387ec5d3bb6a', 'request_id': 'req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.551435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:04.557420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae147c9a5204f85afa4387ec5d3bb6a', 'request_id': 'req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.560168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f1b5fe33374c96865654fc82a23e61', 'request_id': 'req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.568451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f1b5fe33374c96865654fc82a23e61', 'request_id': 'req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.577461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] The token cache is being invalidate because project 8ae147c9a5204f85afa4387ec5d3bb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:04.577759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.578978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.579412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f1b5fe33374c96865654fc82a23e61', 'request_id': 'req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.584223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 923/1852] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:04 2022] DELETE /identity/v3/projects/8ae147c9a5204f85afa4387ec5d3bb6a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:04.587691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:04.589596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:04.601548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] The token cache is being invalidate because project b3f1b5fe33374c96865654fc82a23e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:04.602784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.606852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.611817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 930/1853] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:04 2022] DELETE /identity/v3/projects/b3f1b5fe33374c96865654fc82a23e61 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:04.613006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:04.615178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:04.696906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed15f6-d8f6-424b-825e-3f93e0fe32e8 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:04.701758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:04.702400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:04.702673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:04.702974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] PATH_INFO: `/v3/users/d7fb277b5a4c4437b16e1aa00d76f5e2` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:04.704114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fb277b5a4c4437b16e1aa00d76f5e2)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:04.706285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:04.708298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f327e2b-c453-4a46-9af0-fc7da5ef31ae admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:04.713000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:04.713734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:04.714016 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:04.714288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] PATH_INFO: `/v3/users/0e893d836e804955876109fcf997dac4` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:04.715501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e893d836e804955876109fcf997dac4)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:04.717454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:04.767075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fb277b5a4c4437b16e1aa00d76f5e2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.777091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fb277b5a4c4437b16e1aa00d76f5e2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.777304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e893d836e804955876109fcf997dac4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.785018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e893d836e804955876109fcf997dac4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.785177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fb277b5a4c4437b16e1aa00d76f5e2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.785865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fb277b5a4c4437b16e1aa00d76f5e2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.794495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e893d836e804955876109fcf997dac4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.795377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e893d836e804955876109fcf997dac4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.801067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fb277b5a4c4437b16e1aa00d76f5e2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.810357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 924/1854] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:04 2022] DELETE /identity/v3/users/d7fb277b5a4c4437b16e1aa00d76f5e2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:04.812737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e893d836e804955876109fcf997dac4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:04.819403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 931/1855] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:04 2022] DELETE /identity/v3/users/0e893d836e804955876109fcf997dac4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:05.351315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:05.354646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:05.419509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:05.421103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:05.459922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f1c91-d525-4a4f-8483-07c36da5a85c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:05.465738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:05.530400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:05.561765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:05.562405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.563119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.565669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dfdc6-f0a1-4502-8286-c5cc0cb3b7de admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:05.571081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] PATH_INFO: `/v3/projects/8d83c08595804ce6a01fe46281474c9e` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.574817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d83c08595804ce6a01fe46281474c9e)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:05.576037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:05.577006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.577124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.577311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] PATH_INFO: `/v3/projects/49859f76fb354ec285e9f461616a279a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.580276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49859f76fb354ec285e9f461616a279a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:05.581470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:05.584621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:05.666003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49859f76fb354ec285e9f461616a279a', 'request_id': 'req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.674660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49859f76fb354ec285e9f461616a279a', 'request_id': 'req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.677796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d83c08595804ce6a01fe46281474c9e', 'request_id': 'req-a8cf45e2-096d-4beb-afeb-52617ee70d5b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.684050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49859f76fb354ec285e9f461616a279a', 'request_id': 'req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.690142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d83c08595804ce6a01fe46281474c9e', 'request_id': 'req-a8cf45e2-096d-4beb-afeb-52617ee70d5b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.698114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d83c08595804ce6a01fe46281474c9e', 'request_id': 'req-a8cf45e2-096d-4beb-afeb-52617ee70d5b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.703437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] The token cache is being invalidate because project 49859f76fb354ec285e9f461616a279a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:05.704228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.705468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c63f0f0-8f09-4bc8-ba45-1aca98b888e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.707249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 932/1856] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:05 2022] DELETE /identity/v3/projects/49859f76fb354ec285e9f461616a279a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:05.712580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3df9-9963-411b-950d-ba041b7d66c7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.713491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3df9-9963-411b-950d-ba041b7d66c7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.714181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3df9-9963-411b-950d-ba041b7d66c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.726518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] The token cache is being invalidate because project 8d83c08595804ce6a01fe46281474c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:05.730136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.731695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a8cf45e2-096d-4beb-afeb-52617ee70d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:05.735760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 925/1857] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:05 2022] DELETE /identity/v3/projects/8d83c08595804ce6a01fe46281474c9e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:05.742699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1c52-5d36-456a-93d1-02e8c5d591d0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.743292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1c52-5d36-456a-93d1-02e8c5d591d0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.743590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1c52-5d36-456a-93d1-02e8c5d591d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.754165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a23c3df9-9963-411b-950d-ba041b7d66c7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:05.757436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a23c3df9-9963-411b-950d-ba041b7d66c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:05.771128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9dad1c52-5d36-456a-93d1-02e8c5d591d0 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:05.772563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9dad1c52-5d36-456a-93d1-02e8c5d591d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:05.856908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 933/1858] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:05.865627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.865994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.866460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.885047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 926/1859] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:05.885413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.885706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.885974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.898620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:05.900987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:05.911381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 934/1860] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:05.916478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:05.930866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0cec-6e06-461b-adc7-cad72a08171b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:05.939604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:05.940646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:05.941487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:05.941912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:05.943274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:05.943728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:05.946485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:05.950468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:05.976169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 935/1861] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:05.979746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:05.982065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.012943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 927/1862] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:06.018126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.023305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c693-87b1-44dd-831b-0fabbf5f1291 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.041548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.042292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.042516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.045072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.045764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.048442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a1db-2a93-4148-8211-e1fd690189e7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.051996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.070015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.070767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.071113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.071472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.072323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:06.075234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.076987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.123851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 928/1863] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:06.128619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.145735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 936/1864] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:05 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:06.149900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.161580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424441-02f3-4a70-bbc7-c74f2b0c9c56 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.217912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:06.255253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:06.292204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa16f1-853b-4cc3-b69b-3b576bd76171 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.300754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.301949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.302405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.303511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.305092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.308290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.350058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 937/1865] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:06 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:06.352888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.353653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.354118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.354338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.354786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.355745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.357882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.369386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef5e4-dbc0-4336-8079-0f782f5a80b9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.380282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.381234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.381634 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.381911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.384632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.384782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.399113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 938/1866] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:06.402896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.416361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b48631-2a55-4d35-8f89-0541f736e941 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.423369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.424156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.424628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.425101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.426055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.428711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.447392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 939/1867] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:06.448411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 929/1868] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:06 2022] POST /identity/v3/projects => generated 387 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:06.448900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.450875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.461669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108b95e-fb9d-4d27-8a39-e2affdf68be0 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.529523 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.530211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.530493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.530828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.531477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.534668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.559770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739b01f-d8a4-4221-8294-b48970e75b91 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.566150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2a328-661f-4953-b11c-3a7d36bf463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.566897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2a328-661f-4953-b11c-3a7d36bf463d admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.568031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 940/1869] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:06 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:06.570170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2a328-661f-4953-b11c-3a7d36bf463d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.570475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2a328-661f-4953-b11c-3a7d36bf463d admin admin] PATH_INFO: `/v3/projects/2a88da6cff294eeebe3230b9c21b952b/users/e0600365e460471aa2563a31e6ba1325/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.571298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.595956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e08fd-2b7e-440d-8a81-727441d43673 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.601770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.602442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.602866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.603146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.604242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.606224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.606788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2a328-661f-4953-b11c-3a7d36bf463d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a88da6cff294eeebe3230b9c21b952b, user_id=e0600365e460471aa2563a31e6ba1325, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.610472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2a328-661f-4953-b11c-3a7d36bf463d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.618942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 941/1870] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:06.623133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.634558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 930/1871] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:06 2022] PUT /identity/v3/projects/2a88da6cff294eeebe3230b9c21b952b/users/e0600365e460471aa2563a31e6ba1325/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:06.637593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166d78-d42d-4f1c-b47a-59c4aaa5d0fb admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.663889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.664449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.665103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.742913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] MFA Rules not processed for user `e0600365e460471aa2563a31e6ba1325`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:06.743117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.743117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.743335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:06.743422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.743494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.744350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.746378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.765124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 942/1872] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:06.767731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.789546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04558cc9-9929-4fec-ac34-29cdb4f48303 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.791012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf3c97-40c4-4618-8f30-bb776fa31646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:06.791853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3c97-40c4-4618-8f30-bb776fa31646 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.792214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3c97-40c4-4618-8f30-bb776fa31646 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.792669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf3c97-40c4-4618-8f30-bb776fa31646 admin admin] PATH_INFO: `/v3/projects/3bc111858a474059afae459d9c90e328/users/3be7757cc6df4deca0013ab908039fb0/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.822210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf3c97-40c4-4618-8f30-bb776fa31646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc111858a474059afae459d9c90e328, user_id=3be7757cc6df4deca0013ab908039fb0, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:06.822210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf3c97-40c4-4618-8f30-bb776fa31646 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:06.847150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:06.867471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 943/1873] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:06 2022] PUT /identity/v3/projects/3bc111858a474059afae459d9c90e328/users/3be7757cc6df4deca0013ab908039fb0/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:06.888461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:06.888893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:06.889240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:06.904598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 931/1874] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:06.910147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:06.954216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51031d-a3dd-4285-8ed6-4ab74f7fa98c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:06.970920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] MFA Rules not processed for user `3be7757cc6df4deca0013ab908039fb0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:06.973478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:07.007591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:07.077541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 944/1875] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:07.078814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.136032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.136688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.136967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.137239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.137886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.148371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.202001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bfaeb-a57d-491e-b463-2315db6384dd None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.210084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.211426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.211682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.211862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.214728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.220678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.246438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 932/1876] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:06 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:07.250728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.281866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 945/1877] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:07 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:07.282867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.396876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868733d1-053c-45d9-b5ac-3a77be7e6d22 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.451243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637ed21-5a0a-4772-acbb-4756c3d7d2f3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.467577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.468113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.470916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.471229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.471898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.474136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.499717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.500738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.501190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.501760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.502763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.505054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 946/1878] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:07 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:07.505427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.511466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.529221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:07.536426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c991053-c34d-4d92-bd74-dab1aa461988 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.544915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.546510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.547123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 933/1879] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:07 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:07.549950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.550711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.550926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.551667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.553269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.563159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42df4b-6777-4c29-b9bd-2bfa303755b6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.566055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 947/1880] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:07.570866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.574833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.575367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.575633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.575907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.576574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.578535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.590309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b062604-5944-4af2-9f71-592d6072230d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.595712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 934/1881] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:07.596663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.597402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.598343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.598624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.602980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] PATH_INFO: `/v3/projects/50fe13ab04e54dd3aeb314713aaacc08/users/3cce7fa3193e44f2b7bd974be118b7bc/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.613126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbbf77-70a5-47ac-bce1-7b2812755763 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.620496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.621305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.621962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.622641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.623948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.626540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.630200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fe13ab04e54dd3aeb314713aaacc08, user_id=3cce7fa3193e44f2b7bd974be118b7bc, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.633602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.641176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 935/1882] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:07.646204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.650010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 948/1883] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:07 2022] PUT /identity/v3/projects/50fe13ab04e54dd3aeb314713aaacc08/users/3cce7fa3193e44f2b7bd974be118b7bc/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:07.654732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.659295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b34d63-005e-4533-ad85-7d37d504ab02 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.673862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:07.738522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7bc84d-7b5f-4e3e-946e-dee4d7c22810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.739315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc84d-7b5f-4e3e-946e-dee4d7c22810 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.739725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc84d-7b5f-4e3e-946e-dee4d7c22810 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.740115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7bc84d-7b5f-4e3e-946e-dee4d7c22810 admin admin] PATH_INFO: `/v3/projects/5a3ca349b4774cd487ff898642009afe/users/b5e85106e40f431688cb73a9e5b6ba27/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.748559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d5e4d-c44f-4f9a-acf7-1dca25c74a33 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.754203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.754859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.755716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.755829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.756696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.758038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bc84d-7b5f-4e3e-946e-dee4d7c22810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3ca349b4774cd487ff898642009afe, user_id=b5e85106e40f431688cb73a9e5b6ba27, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.758617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.760962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7bc84d-7b5f-4e3e-946e-dee4d7c22810 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.774711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 949/1884] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:07.777127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.786550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 936/1885] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:07 2022] PUT /identity/v3/projects/5a3ca349b4774cd487ff898642009afe/users/b5e85106e40f431688cb73a9e5b6ba27/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:07.790110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c91f70-9f61-4a4a-8a7a-89861253cefe admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.798047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.798397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.798778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.833790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] MFA Rules not processed for user `b5e85106e40f431688cb73a9e5b6ba27`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:07.835517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:07.854397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3707c6-0fd0-4d1c-b624-0fea637ca25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.855471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3707c6-0fd0-4d1c-b624-0fea637ca25a admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.855471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3707c6-0fd0-4d1c-b624-0fea637ca25a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.855661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3707c6-0fd0-4d1c-b624-0fea637ca25a admin admin] PATH_INFO: `/v3/projects/50fe13ab04e54dd3aeb314713aaacc08/users/3cce7fa3193e44f2b7bd974be118b7bc/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.857672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3707c6-0fd0-4d1c-b624-0fea637ca25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fe13ab04e54dd3aeb314713aaacc08, user_id=3cce7fa3193e44f2b7bd974be118b7bc, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.860363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3707c6-0fd0-4d1c-b624-0fea637ca25a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.870736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 950/1886] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:07 2022] PUT /identity/v3/projects/50fe13ab04e54dd3aeb314713aaacc08/users/3cce7fa3193e44f2b7bd974be118b7bc/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:07.881620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.881987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.882413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.905121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 937/1887] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:07.909624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:07.911642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] MFA Rules not processed for user `3cce7fa3193e44f2b7bd974be118b7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:07.912855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:07.920195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0cac3-b4cb-4aa9-b820-f5691d4e3537 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:07.969262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:07.991707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:07.993067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:07.993445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:07.993816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:07.994696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:07.996762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:07.999093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 951/1888] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:08.010548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.012012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.039410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 938/1889] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:07 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:08.040588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.064906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:08.084955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c5874-45f5-4a02-a44c-8332bd913a57 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.121810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23d340-5f23-44c8-b768-bae5b9f25f87 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.132759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.133894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.134881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.135420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.137040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.139646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.139922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.140535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.140920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.141354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.172669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 939/1890] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:08 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:08.176581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.192003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bef6ca-1ff0-44fd-8579-74402a90a367 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.196335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.197126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.197501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.197874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.198629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.200363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.213796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 940/1891] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:08.217650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.230424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d30de-45fd-4127-9b39-cff1abe2ff50 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.236793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.238392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.240792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.241551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.241898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.242770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] PATH_INFO: `/v3/projects/2bd35c8dc2c04278b1caf3cf943f91a5/users/f62b94a3d65f4010945ce20a5bd8d192/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.249953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 952/1892] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:08.263233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd35c8dc2c04278b1caf3cf943f91a5, user_id=f62b94a3d65f4010945ce20a5bd8d192, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.266016 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.284802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 941/1893] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:08 2022] PUT /identity/v3/projects/2bd35c8dc2c04278b1caf3cf943f91a5/users/f62b94a3d65f4010945ce20a5bd8d192/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:08.292402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.303844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4acee7-490f-43b9-abcd-3fdaa627ed1c service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.339711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.368445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:08.381794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.382413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.382717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.383037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.383854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.385724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.404755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 953/1894] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:08.406976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.426458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0597b-1358-440e-92be-fd44fc845aff admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.433252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.434174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.434803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.435220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] PATH_INFO: `/v3/users/3be7757cc6df4deca0013ab908039fb0` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.436725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be7757cc6df4deca0013ab908039fb0)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.437434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6dd46-3932-4ac9-a66a-e2e6543603e3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.441447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.442255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51291e2-cce2-4142-9e01-1375563bd7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.443517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51291e2-cce2-4142-9e01-1375563bd7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.443797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51291e2-cce2-4142-9e01-1375563bd7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.445229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51291e2-cce2-4142-9e01-1375563bd7fa admin admin] PATH_INFO: `/v3/projects/2bd35c8dc2c04278b1caf3cf943f91a5/users/f62b94a3d65f4010945ce20a5bd8d192/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.447900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51291e2-cce2-4142-9e01-1375563bd7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd35c8dc2c04278b1caf3cf943f91a5, user_id=f62b94a3d65f4010945ce20a5bd8d192, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.451327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51291e2-cce2-4142-9e01-1375563bd7fa admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.467169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 954/1895] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:08 2022] PUT /identity/v3/projects/2bd35c8dc2c04278b1caf3cf943f91a5/users/f62b94a3d65f4010945ce20a5bd8d192/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:08.478903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76662-9883-4519-952c-f1bddb384fee None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.479285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76662-9883-4519-952c-f1bddb384fee None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.479558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76662-9883-4519-952c-f1bddb384fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.512678 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be7757cc6df4deca0013ab908039fb0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.514238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-30c76662-9883-4519-952c-f1bddb384fee None None] MFA Rules not processed for user `f62b94a3d65f4010945ce20a5bd8d192`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:08.515717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-30c76662-9883-4519-952c-f1bddb384fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.529683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be7757cc6df4deca0013ab908039fb0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.541314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be7757cc6df4deca0013ab908039fb0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.542316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be7757cc6df4deca0013ab908039fb0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.555886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:08.564446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a497de68-aaf1-4bfb-8491-351ed5e415f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be7757cc6df4deca0013ab908039fb0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.572229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 942/1896] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:08 2022] DELETE /identity/v3/users/3be7757cc6df4deca0013ab908039fb0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:08.577988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.578484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.578568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.604338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:08.606304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.617840 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 955/1897] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:08.629572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76662-9883-4519-952c-f1bddb384fee None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.631583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-30c76662-9883-4519-952c-f1bddb384fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.688748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 943/1898] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:08.695771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.697983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.710229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76662-9883-4519-952c-f1bddb384fee None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.762948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35928b-e744-4f4e-ab5f-bc7ba3a3541f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.768280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.768906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.769177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.769442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.771238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.776235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.776868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.777149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.777419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.787879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.789516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.799538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 944/1899] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:08.800387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:08.801682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:08.831836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:08.833257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28094aa1-30a6-42ea-8e5a-f0ecf5b3d1fa service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:08.850735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:08.851615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.852145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.852633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] PATH_INFO: `/v3/users/8cf946d5aac74bd9a45477929ddfe8d3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:08.857763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf946d5aac74bd9a45477929ddfe8d3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.862398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.883447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:08.884750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26115ef7-1485-4a30-aeff-1bba0676d5f8 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:08.897610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 956/1900] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:08.933298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf946d5aac74bd9a45477929ddfe8d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.947113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf946d5aac74bd9a45477929ddfe8d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.960976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf946d5aac74bd9a45477929ddfe8d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.961180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf946d5aac74bd9a45477929ddfe8d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.979493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf946d5aac74bd9a45477929ddfe8d3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:08.988060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 945/1901] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:08 2022] DELETE /identity/v3/users/8cf946d5aac74bd9a45477929ddfe8d3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:08.993133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:08.993420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:08.995127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:09.041479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:09.043473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:09.204146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 957/1902] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:09.214324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:09.216288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:09.234985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:09.371025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f859-4cee-4179-a5f8-790f29c6cf31 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:09.382658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:09.383920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:09.386286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:09.386878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:09.411795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:09.425008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:09.451048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 946/1903] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:09.871961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:09.873134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:09.887687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4955c87-b5dc-44a2-ac15-34bc58803518 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:09.894213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:09.894969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:09.895314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:09.895670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] PATH_INFO: `/v3/projects/3bc111858a474059afae459d9c90e328` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:09.896893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc111858a474059afae459d9c90e328)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:09.899395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:09.976318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc111858a474059afae459d9c90e328', 'request_id': 'req-26e1e750-b131-474c-8656-4541459fd2ef'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:09.988341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc111858a474059afae459d9c90e328', 'request_id': 'req-26e1e750-b131-474c-8656-4541459fd2ef'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:09.996271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc111858a474059afae459d9c90e328', 'request_id': 'req-26e1e750-b131-474c-8656-4541459fd2ef'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.012422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] The token cache is being invalidate because project 3bc111858a474059afae459d9c90e328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:10.012735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.014903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.019142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 958/1904] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:09 2022] DELETE /identity/v3/projects/3bc111858a474059afae459d9c90e328 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:10.019816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:10.035385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fada97-48d3-4b2e-9146-c72249568ead service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:10.117805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:10.118460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:10.118851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:10.119129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] PATH_INFO: `/v3/users/3cce7fa3193e44f2b7bd974be118b7bc` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:10.120692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cce7fa3193e44f2b7bd974be118b7bc)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:10.122729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:10.155171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:10.156821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:10.172079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1e750-b131-474c-8656-4541459fd2ef admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:10.177553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:10.178430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:10.178624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:10.179439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] PATH_INFO: `/v3/projects/be31b1e8a7be4d5ebb91821bcb8213ae` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:10.180265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be31b1e8a7be4d5ebb91821bcb8213ae)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:10.182328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:10.191556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cce7fa3193e44f2b7bd974be118b7bc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.200055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cce7fa3193e44f2b7bd974be118b7bc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.207173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cce7fa3193e44f2b7bd974be118b7bc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.207885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cce7fa3193e44f2b7bd974be118b7bc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.222365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cce7fa3193e44f2b7bd974be118b7bc'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.231503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 947/1905] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:10 2022] DELETE /identity/v3/users/3cce7fa3193e44f2b7bd974be118b7bc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:10.235025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:10.237964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be31b1e8a7be4d5ebb91821bcb8213ae', 'request_id': 'req-06fc51bb-5627-4708-97ee-e0c6f99bb398'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.244797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be31b1e8a7be4d5ebb91821bcb8213ae', 'request_id': 'req-06fc51bb-5627-4708-97ee-e0c6f99bb398'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.255530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be31b1e8a7be4d5ebb91821bcb8213ae', 'request_id': 'req-06fc51bb-5627-4708-97ee-e0c6f99bb398'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.270601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] The token cache is being invalidate because project be31b1e8a7be4d5ebb91821bcb8213ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:10.270998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.272087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.273643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 959/1906] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:10 2022] DELETE /identity/v3/projects/be31b1e8a7be4d5ebb91821bcb8213ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:10.277683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:10.279776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:10.317688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:10.372349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c48f6-55ec-40cd-a08b-89c71781e542 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:10.382974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:10.383847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:10.384289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:10.384721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] PATH_INFO: `/v3/users/67486f43f2284475b771bbf672ae9d7e` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:10.386028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67486f43f2284475b771bbf672ae9d7e)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:10.388291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:10.467833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67486f43f2284475b771bbf672ae9d7e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.478544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67486f43f2284475b771bbf672ae9d7e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.489211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67486f43f2284475b771bbf672ae9d7e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.490175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67486f43f2284475b771bbf672ae9d7e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.513911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67486f43f2284475b771bbf672ae9d7e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.533858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 948/1907] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:10 2022] DELETE /identity/v3/users/67486f43f2284475b771bbf672ae9d7e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:10.619965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:10.621964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:10.653506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:10.655255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:10.722436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc51bb-5627-4708-97ee-e0c6f99bb398 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:10.794746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:10.795895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:10.796406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0414ca-571b-4b98-8fce-df81e34154e3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:10.796815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:10.797287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:10.799536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:10.801950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:10.802879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:10.803249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:10.803547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] PATH_INFO: `/v3/projects/50fe13ab04e54dd3aeb314713aaacc08` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:10.804743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fe13ab04e54dd3aeb314713aaacc08)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:10.806945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:10.866272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:10.870964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fe13ab04e54dd3aeb314713aaacc08', 'request_id': 'req-60f058a2-eeb2-484a-a41e-b6d162e0b252'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.883009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fe13ab04e54dd3aeb314713aaacc08', 'request_id': 'req-60f058a2-eeb2-484a-a41e-b6d162e0b252'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.895685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:10.898503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fc236-56c2-4db4-b72f-324b7ef8a968 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:10.911318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fe13ab04e54dd3aeb314713aaacc08', 'request_id': 'req-60f058a2-eeb2-484a-a41e-b6d162e0b252'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.913760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 960/1908] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:10.934037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] The token cache is being invalidate because project 50fe13ab04e54dd3aeb314713aaacc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:10.934335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.935540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:10.940782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 949/1909] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:10 2022] DELETE /identity/v3/projects/50fe13ab04e54dd3aeb314713aaacc08 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:10.947493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc304a54-02f1-4f20-add8-7dcae53b4675 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:10.947992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc304a54-02f1-4f20-add8-7dcae53b4675 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:10.948288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc304a54-02f1-4f20-add8-7dcae53b4675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:10.977778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-bc304a54-02f1-4f20-add8-7dcae53b4675 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:10.979191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bc304a54-02f1-4f20-add8-7dcae53b4675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:10.998035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:10.999579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:11.047929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:11.091500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 961/1910] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:11.098542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.098862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.099132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.120405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f058a2-eeb2-484a-a41e-b6d162e0b252 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.124382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:11.125743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:11.131826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.134287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.134624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.134944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] PATH_INFO: `/v3/projects/748a4414ae8349f0be6d04ee6850c747` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.138704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 962/1911] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:11.139626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.139872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=748a4414ae8349f0be6d04ee6850c747)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.141844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.150877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cc154-5082-4139-8ef9-2b002797eb75 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.156059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.156953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.157160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.157587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.158271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:11.158659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.160399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.176805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 963/1912] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:11.177849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.189116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721755b-f89e-4adf-a79c-b0611bec4361 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.197326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.198033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.198407 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.198799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.199632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.201736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.243062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 964/1913] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:11.245239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.254310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '748a4414ae8349f0be6d04ee6850c747', 'request_id': 'req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:11.260614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '748a4414ae8349f0be6d04ee6850c747', 'request_id': 'req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:11.273470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '748a4414ae8349f0be6d04ee6850c747', 'request_id': 'req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:11.299164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] The token cache is being invalidate because project 748a4414ae8349f0be6d04ee6850c747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:11.299164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:11.299886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-829daf3e-3157-4c2f-97c9-daaa6a6b5c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:11.301815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 950/1914] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:10 2022] DELETE /identity/v3/projects/748a4414ae8349f0be6d04ee6850c747 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:11.308823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.309275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.309700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.344924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:11.351360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:11.427190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1ec6-f654-49a1-9f15-09700024f884 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.440031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12a82d-266d-4959-bb43-c492849afa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.440736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12a82d-266d-4959-bb43-c492849afa6d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.441144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12a82d-266d-4959-bb43-c492849afa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.441464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12a82d-266d-4959-bb43-c492849afa6d admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.442220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12a82d-266d-4959-bb43-c492849afa6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.444392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12a82d-266d-4959-bb43-c492849afa6d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.486615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 951/1915] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:11.491182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 965/1916] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:11.495422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.496773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.497008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.497347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.500042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:11.519580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b756e-4742-40f0-9a82-fbca6e015956 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.527996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.529019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.529399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.529681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.530464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.532544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.536501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:11.541656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:11.549874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:11.552228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 952/1917] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:11.557294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.572478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 966/1918] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:11.580038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275c562-e06b-435e-951b-d38304935dff admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.582517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.593885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322278d-d09c-4ff8-b0d7-321e07028296 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.599516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.599891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.600349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.600802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.600936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.601036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.601120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.601322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.601738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:11.602149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.602571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.604242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.604465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.616395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 953/1919] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:11.625728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.626444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 967/1920] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:11.627798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.639439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37e6d1-5df4-4f58-8307-50329eb6f354 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.644201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fd240-a885-414f-89be-c67acc63fe7d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.646869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.648700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.649213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.650029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.651230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.654894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69529916-971a-4862-a17a-aa2e872e2a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.655884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529916-971a-4862-a17a-aa2e872e2a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.656360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.656708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529916-971a-4862-a17a-aa2e872e2a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.659211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69529916-971a-4862-a17a-aa2e872e2a44 admin admin] PATH_INFO: `/v3/projects/ad0d45240612421f91dbe0fb05822831/users/3a5e6253b0454eda8a754559dea638e7/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.683014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69529916-971a-4862-a17a-aa2e872e2a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0d45240612421f91dbe0fb05822831, user_id=3a5e6253b0454eda8a754559dea638e7, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.685778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69529916-971a-4862-a17a-aa2e872e2a44 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.698513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 968/1921] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:11.699733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.706721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 954/1922] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:11 2022] PUT /identity/v3/projects/ad0d45240612421f91dbe0fb05822831/users/3a5e6253b0454eda8a754559dea638e7/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:11.717363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.717718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.718054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.756338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] MFA Rules not processed for user `3a5e6253b0454eda8a754559dea638e7`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:11.757604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:11.820069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:11.841494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbfc80-d877-4ccf-a99a-d05006ded939 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.881373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 955/1923] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:11.882942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.936596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.937205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.937482 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.937747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.938401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.940343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.966842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c2e27-1e68-4e33-b2a5-a484da4f5831 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:11.975396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:11.977888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:11.977888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:11.977888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:11.977888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:11.980057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:11.987569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 969/1924] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:11.989057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:11.991236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:12.025592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 956/1925] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:11 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:12.029560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.068603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ced76-113a-40e3-9fde-a1df026f0cb9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.100041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:12.134620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.134620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.134837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.135112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.137173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:12.141299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd06172e-d3f8-45e9-9616-565a2f71bd8d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.147393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.148077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.148419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.148905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.149637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.151450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.165290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 957/1926] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:12.165290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.173573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224dff0a-8198-405a-adbe-b3fbf042b39d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.178952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.179649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.179939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.180301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.180941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.182921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.204733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 958/1927] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:12 2022] POST /identity/v3/users => generated 297 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:12.205464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.207963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:12.211188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.213121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.215151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7dfcd-a358-4a12-915c-0862f34b9135 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.220223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.220878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.221148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.221477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.222041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.223661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.227246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 970/1928] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:12.228866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.235741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 959/1929] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:12.239582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.241626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1423d2e-af37-4c5b-8f84-609e168c3780 service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.247575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.248181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.248454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.248724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.249577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.249883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0e217-2b58-4e71-bb88-5e77017d60b3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.251199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.255145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edec16e-aa94-45b4-9e4e-c0acafb5f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.255953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec16e-aa94-45b4-9e4e-c0acafb5f978 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.256271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec16e-aa94-45b4-9e4e-c0acafb5f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.256609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec16e-aa94-45b4-9e4e-c0acafb5f978 admin admin] PATH_INFO: `/v3/projects/2162773ffb404fc7891d7649976153c2/users/19368d54f71549278f3cf287b01610b1/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.265965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 971/1930] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:12.266922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.278257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735939-9ac8-4892-a16a-3f260e16b58d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.281065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec16e-aa94-45b4-9e4e-c0acafb5f978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2162773ffb404fc7891d7649976153c2, user_id=19368d54f71549278f3cf287b01610b1, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.284149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.284640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edec16e-aa94-45b4-9e4e-c0acafb5f978 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.284832 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.285113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.285405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] PATH_INFO: `/v3/projects/37217550f7f542b799bf91c8e8bfdbcc/users/bee63f9e2c084d22a2efe259e8b531b2/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.304892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=37217550f7f542b799bf91c8e8bfdbcc, user_id=bee63f9e2c084d22a2efe259e8b531b2, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.308339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 960/1931] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:12 2022] PUT /identity/v3/projects/2162773ffb404fc7891d7649976153c2/users/19368d54f71549278f3cf287b01610b1/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:12.309185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.319378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.319675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.319982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.329686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 972/1932] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:12 2022] PUT /identity/v3/projects/37217550f7f542b799bf91c8e8bfdbcc/users/bee63f9e2c084d22a2efe259e8b531b2/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:12.334310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.359829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] MFA Rules not processed for user `19368d54f71549278f3cf287b01610b1`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:12.361237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:12.438388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a9534-ddde-439c-97aa-4648c156cc6c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.444510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.445215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.445502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.445957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.447499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.449127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.461459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 961/1933] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:12.461628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 973/1934] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:12.464712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.476551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a656e1-5646-49de-956e-f637c6779d38 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.477730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.479975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:12.482469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d89fc-c4c0-49c0-90fa-b6c26b22dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.483304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d89fc-c4c0-49c0-90fa-b6c26b22dc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.483647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d89fc-c4c0-49c0-90fa-b6c26b22dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.484165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d89fc-c4c0-49c0-90fa-b6c26b22dc7b admin admin] PATH_INFO: `/v3/projects/37217550f7f542b799bf91c8e8bfdbcc/users/bee63f9e2c084d22a2efe259e8b531b2/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.496801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d89fc-c4c0-49c0-90fa-b6c26b22dc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37217550f7f542b799bf91c8e8bfdbcc, user_id=bee63f9e2c084d22a2efe259e8b531b2, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.499522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d89fc-c4c0-49c0-90fa-b6c26b22dc7b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.511674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 962/1935] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:12 2022] PUT /identity/v3/projects/37217550f7f542b799bf91c8e8bfdbcc/users/bee63f9e2c084d22a2efe259e8b531b2/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:12.524191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.524566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.524916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.564409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] MFA Rules not processed for user `bee63f9e2c084d22a2efe259e8b531b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:12.566084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:12.597484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f1cc0-5deb-4e2d-8bb9-01dc2d2a8aba admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.639256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:12.662473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.663661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.664834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.665473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.674859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:12.705894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 963/1936] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:12.720138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:12.721917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:12.753256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.755030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.770354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 974/1937] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:12.810399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedf140-5e61-4acd-a4e0-fc2be55d4fb0 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:12.814879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:12.815566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:12.816483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:12.816483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:12.826896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:12.828499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:12.840404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 964/1938] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:12 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:13.200352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:13.216129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e57400-b2b2-4c3e-9de9-7ae071f69c95 service glance] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:13.222031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee63f9e2c084d22a2efe259e8b531b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37217550f7f542b799bf91c8e8bfdbcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:13.222874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:13.223332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:13.223701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:13.224629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:13.225167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:13.227258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:13.262431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 975/1939] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:13.264068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:13.288839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f46c-2145-4b53-9457-6b41c9b4798b service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:13.300364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee63f9e2c084d22a2efe259e8b531b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37217550f7f542b799bf91c8e8bfdbcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:13.300992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:13.301274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:13.301533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:13.302327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:13.304383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:13.363841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 965/1940] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:13 2022] POST /identity/v3/projects => generated 355 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:13.365949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:13.381899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea44a2-240c-4f13-805b-fdc7d1e990b7 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:13.538398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee63f9e2c084d22a2efe259e8b531b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37217550f7f542b799bf91c8e8bfdbcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:13.539344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:13.539891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:13.540235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:13.541207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:13.542268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:13.544397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:13.575584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 976/1941] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:13.611049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:13.623010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62a2f7-f92f-4bdc-86bd-df2bb2899621 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:13.630034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee63f9e2c084d22a2efe259e8b531b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37217550f7f542b799bf91c8e8bfdbcc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:13.630807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:13.631338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:13.631806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] PATH_INFO: `/v3/projects/bc7ab592376a42ff9db0d412af96845d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:13.633079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc7ab592376a42ff9db0d412af96845d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:13.635506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:13.689391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7ab592376a42ff9db0d412af96845d', 'request_id': 'req-b7520cb8-f513-49ed-b426-8ede99726731'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:13.696611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7ab592376a42ff9db0d412af96845d', 'request_id': 'req-b7520cb8-f513-49ed-b426-8ede99726731'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:13.706446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7ab592376a42ff9db0d412af96845d', 'request_id': 'req-b7520cb8-f513-49ed-b426-8ede99726731'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:13.722021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] The token cache is being invalidate because project bc7ab592376a42ff9db0d412af96845d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:13.722320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:13.722965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b7520cb8-f513-49ed-b426-8ede99726731 tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:13.724733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 966/1942] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:13 2022] DELETE /identity/v3/projects/bc7ab592376a42ff9db0d412af96845d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:14.025937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:14.027919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:14.100620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04b784-e520-4fc2-a4e2-badad95b3fea tempest-VolumeQuotaClassesTest-1814779699 tempest-VolumeQuotaClassesTest-1814779699-project-admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:14.132794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:14.157831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:14.158540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:14.158857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:14.159127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] PATH_INFO: `/v3/users/3a5e6253b0454eda8a754559dea638e7` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:14.160254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a5e6253b0454eda8a754559dea638e7)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:14.162165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:14.216548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a5e6253b0454eda8a754559dea638e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:14.223417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a5e6253b0454eda8a754559dea638e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:14.231969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a5e6253b0454eda8a754559dea638e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:14.232576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a5e6253b0454eda8a754559dea638e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:14.244174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a5e6253b0454eda8a754559dea638e7'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:14.250094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 977/1943] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:14 2022] DELETE /identity/v3/users/3a5e6253b0454eda8a754559dea638e7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:14.254576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:14.254905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:14.255175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:14.274433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:14.275807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:14.324311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:14.345101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 967/1944] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:14.355458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:14.357019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:14.420662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d346c72-4cec-4543-8ef1-4ee405db1c52 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:14.424792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:14.425388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:14.425659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:14.425924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:14.438853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:14.440318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:14.450348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 978/1945] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:15.108566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:15.110113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:15.160235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29d4a-56a8-4802-8874-830e0c2b55f6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:15.166413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:15.167481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:15.168258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:15.168882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] PATH_INFO: `/v3/projects/ad0d45240612421f91dbe0fb05822831` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:15.177239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0d45240612421f91dbe0fb05822831)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:15.180601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:15.402735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0d45240612421f91dbe0fb05822831', 'request_id': 'req-a896e31b-6634-476d-bf7c-ccff0d1caa5b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.415799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0d45240612421f91dbe0fb05822831', 'request_id': 'req-a896e31b-6634-476d-bf7c-ccff0d1caa5b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.430816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0d45240612421f91dbe0fb05822831', 'request_id': 'req-a896e31b-6634-476d-bf7c-ccff0d1caa5b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.449218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] The token cache is being invalidate because project ad0d45240612421f91dbe0fb05822831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:15.449740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.450701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.452714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 968/1946] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:15 2022] DELETE /identity/v3/projects/ad0d45240612421f91dbe0fb05822831 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:15.457241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:15.478824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd339b-75a5-47f4-9bdd-bcdb4e5f58b3 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:15.587755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:15.612493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:15.613149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:15.613425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:15.613693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] PATH_INFO: `/v3/users/bee63f9e2c084d22a2efe259e8b531b2` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:15.621128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee63f9e2c084d22a2efe259e8b531b2)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:15.621128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:15.677821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee63f9e2c084d22a2efe259e8b531b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.686636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee63f9e2c084d22a2efe259e8b531b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.702947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee63f9e2c084d22a2efe259e8b531b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.704326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee63f9e2c084d22a2efe259e8b531b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.723504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c0faf52-902f-4ac9-8ee0-7acda9d2ab8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee63f9e2c084d22a2efe259e8b531b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:15.732642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 979/1947] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:15 2022] DELETE /identity/v3/users/bee63f9e2c084d22a2efe259e8b531b2 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:16.052987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.054531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:16.070088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896e31b-6634-476d-bf7c-ccff0d1caa5b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.162978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.163631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.163914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.164186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] PATH_INFO: `/v3/projects/37217550f7f542b799bf91c8e8bfdbcc` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.165451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37217550f7f542b799bf91c8e8bfdbcc)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.167715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.234610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37217550f7f542b799bf91c8e8bfdbcc', 'request_id': 'req-73436c95-ea80-44b2-9638-9a4084bcc247'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.242771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37217550f7f542b799bf91c8e8bfdbcc', 'request_id': 'req-73436c95-ea80-44b2-9638-9a4084bcc247'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.249826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37217550f7f542b799bf91c8e8bfdbcc', 'request_id': 'req-73436c95-ea80-44b2-9638-9a4084bcc247'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.259624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:16.266246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] The token cache is being invalidate because project 37217550f7f542b799bf91c8e8bfdbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:16.267221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.268815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-73436c95-ea80-44b2-9638-9a4084bcc247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.272112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 969/1948] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:16 2022] DELETE /identity/v3/projects/37217550f7f542b799bf91c8e8bfdbcc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:16.280974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.281677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.282939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.306776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:16.307985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:16.374310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 980/1949] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:16.382296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.382663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.383033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.405119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:16.406672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:16.415486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 970/1950] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:16.420108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.430385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0c2ee-a890-4171-8180-55db54b566e2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.436706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.437714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.437996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.438267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.438962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:16.439263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.440894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.453201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 981/1951] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:16.457773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.467778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe47e7-5022-43aa-9f19-f05a055241a7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.476482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.477165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.477415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.477679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.478396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.480498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.513878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 971/1952] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:16 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:16.515211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.527195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e2d43-ee7f-4a88-9d6d-17df6963b6f6 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.620842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.621499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.621775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.622094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.622753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.627598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.644820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:16.662438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 982/1953] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:16 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:16.667243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.681096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fef910-b7c5-407d-aa55-648b7ffd4b6d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.688226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.688577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.689126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.689516 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.689885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.690650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.691099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:16.695852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.708966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359baad-de11-4d0b-ad4d-0a3b55e72c6e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.709419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 972/1954] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:16.713620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.714307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.715189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.715655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.716072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] PATH_INFO: `/v3/users/e0600365e460471aa2563a31e6ba1325` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.717987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0600365e460471aa2563a31e6ba1325)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.720384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.726253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb869c-e1d9-4f6e-9e0b-7a2ef1504321 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.733145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.733869 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.734229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.734557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.735341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.737088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.754857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 973/1955] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:16.758352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.771379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9917f43-c9c7-4028-a0ec-66460d74abe6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:16.779661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cd4e4-3bde-4031-8e5b-9d63d64bd068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:16.780717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd4e4-3bde-4031-8e5b-9d63d64bd068 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.781054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd4e4-3bde-4031-8e5b-9d63d64bd068 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.781730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cd4e4-3bde-4031-8e5b-9d63d64bd068 admin admin] PATH_INFO: `/v3/projects/cb38d69e8f7f4e7dac40b651cf5ebbff/users/ac1e8a03fbfc4030b9ad88f82721906a/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.794336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0600365e460471aa2563a31e6ba1325'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.803892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0600365e460471aa2563a31e6ba1325'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.813531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cd4e4-3bde-4031-8e5b-9d63d64bd068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb38d69e8f7f4e7dac40b651cf5ebbff, user_id=ac1e8a03fbfc4030b9ad88f82721906a, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:16.816267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cd4e4-3bde-4031-8e5b-9d63d64bd068 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:16.820273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0600365e460471aa2563a31e6ba1325'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.822211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0600365e460471aa2563a31e6ba1325'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.837735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3cf92cf5-1a5e-4214-8d9c-47bf7a1b4a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0600365e460471aa2563a31e6ba1325'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:16.847107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 983/1957] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:16 2022] DELETE /identity/v3/users/e0600365e460471aa2563a31e6ba1325 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:16.847405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 974/1957] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:16 2022] PUT /identity/v3/projects/cb38d69e8f7f4e7dac40b651cf5ebbff/users/ac1e8a03fbfc4030b9ad88f82721906a/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:16.856269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.856560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.856834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.858663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:16.859039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:16.859316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:16.887879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:16.889177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:16.895217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] MFA Rules not processed for user `ac1e8a03fbfc4030b9ad88f82721906a`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:16.896497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:16.972704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 975/1958] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:16.992356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:16.995497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:17.007999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 984/1959] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:17.012360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.013684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:17.027878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072577a5-db5d-43aa-999f-745bea2d8c9a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.032613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.033237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.033508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.033772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.034398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.036423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.071373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 985/1960] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:17 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:17.072445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.086131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4124f-5fe0-4d2c-af9e-d763d997099c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.113137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:17.135650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:17.152760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447e19-8c73-4694-b308-108c50b7cbc4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.158888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.159693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.159938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.160212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.160854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.161149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.162246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.162908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.163042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.163541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.174831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.180609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.196487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 986/1961] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:17 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:17.196690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 976/1962] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:17.197635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.215431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4308d25-5700-4b1f-9885-e39f3fb5b42a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.219545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.220166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.220518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.220794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.221452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.223439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.240145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 987/1963] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:17.241439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.254940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0511-f97b-4ff5-b737-80cdcea4bf6d service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.261113 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bff4c6-e872-4cc1-9182-7a470c2287b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.261733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bff4c6-e872-4cc1-9182-7a470c2287b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.262778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bff4c6-e872-4cc1-9182-7a470c2287b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.263049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bff4c6-e872-4cc1-9182-7a470c2287b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.267812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bff4c6-e872-4cc1-9182-7a470c2287b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.270431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bff4c6-e872-4cc1-9182-7a470c2287b2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.288556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 977/1964] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:17.290180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.301479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10895ae-8045-4b44-9341-f417b50cafbc admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.307018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.307761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.308025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.308299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] PATH_INFO: `/v3/projects/a32978fed0444f048e6c4f9f377aed8f/users/2b3b6f8e7e2247638d4bfadf1d90a928/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.330777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a32978fed0444f048e6c4f9f377aed8f, user_id=2b3b6f8e7e2247638d4bfadf1d90a928, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.333908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.374180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 988/1965] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:17 2022] PUT /identity/v3/projects/a32978fed0444f048e6c4f9f377aed8f/users/2b3b6f8e7e2247638d4bfadf1d90a928/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:17.376600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.376917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.377187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.421118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] MFA Rules not processed for user `2b3b6f8e7e2247638d4bfadf1d90a928`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:17.422421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:17.534723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 978/1966] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:17.538958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.618279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2592ca-d743-4356-94cc-5326cc49699f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.623632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.624346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.624692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.625024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.625771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.627982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.682475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 989/1967] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:17 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:17.683019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.698772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9e881-eb55-4751-b76b-5830cf364bf1 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.775957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.776611 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.776889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.777164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.777816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.780075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.827653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.828354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 979/1968] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:17 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:17.844244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620efae-605d-4dc2-af9c-ad0c92d24f0c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.854611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.855335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.855662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.855932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.856937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.858536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.875767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 990/1969] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:17.880316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.891391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567fd092-0706-4338-be80-2c2a0c9e22d4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.896703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:17.897379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:17.897660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:17.897933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] PATH_INFO: `/v3/projects/0018d1e6ee184c0cbb4686dac3f6d7b7/users/9b01abb221a445688235eb2c7dd3cf1b/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:17.925681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0018d1e6ee184c0cbb4686dac3f6d7b7, user_id=9b01abb221a445688235eb2c7dd3cf1b, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:17.929261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:17.963161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 980/1970] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:17 2022] PUT /identity/v3/projects/0018d1e6ee184c0cbb4686dac3f6d7b7/users/9b01abb221a445688235eb2c7dd3cf1b/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:17.964079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.980377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f0109-d1c1-496f-8566-a6c3c4281d61 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:17.987291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:17.990024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:18.038215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:18.084232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130deba-d6a8-4dff-853e-706a313a1fa7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:18.091136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:18.091804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:18.092086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:18.092362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] PATH_INFO: `/v3/projects/2a88da6cff294eeebe3230b9c21b952b` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:18.093615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a88da6cff294eeebe3230b9c21b952b)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:18.095583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:18.138516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:18.139330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:18.139734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:18.140096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:18.141589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:18.144250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:18.152345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:18.164486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 991/1971] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:18.167536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:18.181574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3a551-4b8e-4529-80bb-b7c5de0115cd admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:18.181825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a88da6cff294eeebe3230b9c21b952b', 'request_id': 'req-e9aca3ed-6591-4951-a611-fd6627837101'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.188870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a88da6cff294eeebe3230b9c21b952b', 'request_id': 'req-e9aca3ed-6591-4951-a611-fd6627837101'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.198125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a88da6cff294eeebe3230b9c21b952b', 'request_id': 'req-e9aca3ed-6591-4951-a611-fd6627837101'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.216734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] The token cache is being invalidate because project 2a88da6cff294eeebe3230b9c21b952b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:18.217409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.218138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.222624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 981/1972] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:17 2022] DELETE /identity/v3/projects/2a88da6cff294eeebe3230b9c21b952b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:18.230889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:18.232747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:18.254917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4494d5-2195-4474-aae6-2f636b5570eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:18.255597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4494d5-2195-4474-aae6-2f636b5570eb admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:18.255872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4494d5-2195-4474-aae6-2f636b5570eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:18.256305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4494d5-2195-4474-aae6-2f636b5570eb admin admin] PATH_INFO: `/v3/projects/0018d1e6ee184c0cbb4686dac3f6d7b7/users/9b01abb221a445688235eb2c7dd3cf1b/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:18.258146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4494d5-2195-4474-aae6-2f636b5570eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0018d1e6ee184c0cbb4686dac3f6d7b7, user_id=9b01abb221a445688235eb2c7dd3cf1b, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:18.261348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4494d5-2195-4474-aae6-2f636b5570eb admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:18.274908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 992/1973] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:18 2022] PUT /identity/v3/projects/0018d1e6ee184c0cbb4686dac3f6d7b7/users/9b01abb221a445688235eb2c7dd3cf1b/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:18.286056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:18.286347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:18.286626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:18.372300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] MFA Rules not processed for user `9b01abb221a445688235eb2c7dd3cf1b`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:18.375283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:18.391967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aca3ed-6591-4951-a611-fd6627837101 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:18.454699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:18.455396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:18.455637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:18.456055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] PATH_INFO: `/v3/users/b5e85106e40f431688cb73a9e5b6ba27` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:18.457324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e85106e40f431688cb73a9e5b6ba27)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:18.459327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:18.464464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:18.468017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 993/1974] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:18.480644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:18.482777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:18.519270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e85106e40f431688cb73a9e5b6ba27'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.530208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e85106e40f431688cb73a9e5b6ba27'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.540816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e85106e40f431688cb73a9e5b6ba27'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.541657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e85106e40f431688cb73a9e5b6ba27'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.557237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e85106e40f431688cb73a9e5b6ba27'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:18.557394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b08b0b-1f9b-477f-9ded-1deb9468f554 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:18.561905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:18.562534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:18.562861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:18.563133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:18.564929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:18.572200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 982/1975] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:18 2022] DELETE /identity/v3/users/b5e85106e40f431688cb73a9e5b6ba27 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:18.581678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:18.583752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:18.595790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 994/1976] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:18.990940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:18.992427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:19.095176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b9187-3e03-4309-ad7e-d2305967f608 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:19.100459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:19.101137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:19.101414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:19.101685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] PATH_INFO: `/v3/projects/5a3ca349b4774cd487ff898642009afe` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:19.102883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3ca349b4774cd487ff898642009afe)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:19.104886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:19.166962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3ca349b4774cd487ff898642009afe', 'request_id': 'req-117bb6ee-1b90-4c4e-ac2a-91abf4427600'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.173279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3ca349b4774cd487ff898642009afe', 'request_id': 'req-117bb6ee-1b90-4c4e-ac2a-91abf4427600'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.180119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3ca349b4774cd487ff898642009afe', 'request_id': 'req-117bb6ee-1b90-4c4e-ac2a-91abf4427600'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.219067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] The token cache is being invalidate because project 5a3ca349b4774cd487ff898642009afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:19.219367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.221455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.226788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 983/1977] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:18 2022] DELETE /identity/v3/projects/5a3ca349b4774cd487ff898642009afe => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:19.231020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:19.250992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7df430-302d-4c83-a0b1-da560f6485ad service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:19.278543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:19.373532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:19.374598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:19.375203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:19.377154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] PATH_INFO: `/v3/users/f62b94a3d65f4010945ce20a5bd8d192` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:19.379611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62b94a3d65f4010945ce20a5bd8d192)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:19.383740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:19.458380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:19.460037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:19.490501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:19.506803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62b94a3d65f4010945ce20a5bd8d192'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.516750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62b94a3d65f4010945ce20a5bd8d192'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.533190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62b94a3d65f4010945ce20a5bd8d192'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.534473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62b94a3d65f4010945ce20a5bd8d192'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.550230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb6ee-1b90-4c4e-ac2a-91abf4427600 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:19.554428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:19.555459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:19.555668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:19.556038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:19.557533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62b94a3d65f4010945ce20a5bd8d192'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:19.558142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:19.567097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 995/1978] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:19 2022] DELETE /identity/v3/users/f62b94a3d65f4010945ce20a5bd8d192 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:19.639952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:19.641970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47c1ae-8a39-4279-ad95-7fe905293470 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:19.661615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 984/1979] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:20.237175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.239118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:20.338525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f53e2-e826-4aba-86da-2c53b8875467 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.343501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.344173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.344433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.344698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] PATH_INFO: `/v3/projects/2bd35c8dc2c04278b1caf3cf943f91a5` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.345972 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd35c8dc2c04278b1caf3cf943f91a5)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.348025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.392819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:20.401165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd35c8dc2c04278b1caf3cf943f91a5', 'request_id': 'req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:20.407870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd35c8dc2c04278b1caf3cf943f91a5', 'request_id': 'req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:20.414801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd35c8dc2c04278b1caf3cf943f91a5', 'request_id': 'req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:20.430633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] The token cache is being invalidate because project 2bd35c8dc2c04278b1caf3cf943f91a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:20.430862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:20.431519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5c402162-9b91-4cfc-a81a-f4c66ffa2f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:20.433982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 996/1980] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:20 2022] DELETE /identity/v3/projects/2bd35c8dc2c04278b1caf3cf943f91a5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:20.438782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.439294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.439524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.463771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:20.465003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:20.531560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 985/1981] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:20.540598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.540975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.541386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.566028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:20.567457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:20.575922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 997/1982] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:20.580364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.591191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465be3a-98c5-4206-9dc4-bea0d68c32a8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.598440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.599525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.599904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.600362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.601901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:20.601901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.603238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.618367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 986/1983] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:48:20.620359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.629991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f331dde-b435-4d7d-9cd0-2cb19ff51200 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.634710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.635309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.635586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.635857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.636477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.638370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.669830 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 998/1984] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:20 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:20.670961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.684736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520126e5-05d5-48b4-9a77-4b88ee45ec7b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.752396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:20.764115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.764922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.765203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.765606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.766240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.769262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.797810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 987/1985] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:20 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:20.802185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.819460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582eb88b-26bd-46ee-bd02-e63898a2fd4f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.824174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.824950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.825219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.825558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.827275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.829172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.844125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 999/1986] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:20.847986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.858363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ef030-eba9-479f-9cba-7c8b421d7e8c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.867224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced0e9b-98dd-43e6-b4fd-14c3b15ba23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.870343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0e9b-98dd-43e6-b4fd-14c3b15ba23b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.870343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0e9b-98dd-43e6-b4fd-14c3b15ba23b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.870343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced0e9b-98dd-43e6-b4fd-14c3b15ba23b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.870343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0e9b-98dd-43e6-b4fd-14c3b15ba23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.872868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced0e9b-98dd-43e6-b4fd-14c3b15ba23b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.887915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 988/1987] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:20.891265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:20.916161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63401014-4631-4a26-8ddc-2ebd41e18233 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:20.928952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:20.929567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.929840 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.930113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] PATH_INFO: `/v3/projects/67a93af728d64eb589d8c8ac1e9fdf22/users/d74cbd6d82c84a1294af1af356d3d93a/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:20.948252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] RBAC: Authorizing `identity:create_grant(project_id=67a93af728d64eb589d8c8ac1e9fdf22, user_id=d74cbd6d82c84a1294af1af356d3d93a, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:20.951057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:20.968464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1000/1988] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:20 2022] PUT /identity/v3/projects/67a93af728d64eb589d8c8ac1e9fdf22/users/d74cbd6d82c84a1294af1af356d3d93a/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:20.976371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0369c2f-3fc6-4054-8405-eb844408d0fc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:20.977426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0369c2f-3fc6-4054-8405-eb844408d0fc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:20.977426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0369c2f-3fc6-4054-8405-eb844408d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:21.004929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e0369c2f-3fc6-4054-8405-eb844408d0fc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:21.006559 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e0369c2f-3fc6-4054-8405-eb844408d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:21.107430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 989/1989] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:21.133067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:21.137818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:21.198411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953694dc-c816-4585-a5e1-06f0201997db admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:21.202297 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:21.202963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:21.203241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:21.203509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:21.213495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:21.214997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:21.224997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1001/1990] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:23.060124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:23.061206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:23.061685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:23.141254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] MFA Rules not processed for user `d74cbd6d82c84a1294af1af356d3d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:23.142800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:23.327092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 990/1991] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:23.336046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:23.337625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:23.508616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3078cd4-3e32-436f-99a4-4d07074097e1 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:23.539068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97449f56-1161-4b09-9266-5f02c9caf0e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:23.540732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449f56-1161-4b09-9266-5f02c9caf0e1 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:23.541117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449f56-1161-4b09-9266-5f02c9caf0e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:23.541520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97449f56-1161-4b09-9266-5f02c9caf0e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:23.568883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97449f56-1161-4b09-9266-5f02c9caf0e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:23.570093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97449f56-1161-4b09-9266-5f02c9caf0e1 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:23.597117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1002/1992] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:24.225218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:24.227354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:24.244873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ffdda-9c6b-426e-ad90-40d3d2f27863 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:24.250925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:24.252559 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:24.253321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:24.253678 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:24.258981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:24.341748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:24.343245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:24.354111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 991/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:25.217456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb697d6c-f687-49aa-ae21-0f625f8ee528 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:25.218000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb697d6c-f687-49aa-ae21-0f625f8ee528 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:25.218000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb697d6c-f687-49aa-ae21-0f625f8ee528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:25.246449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-fb697d6c-f687-49aa-ae21-0f625f8ee528 None None] MFA Rules not processed for user `d74cbd6d82c84a1294af1af356d3d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:25.247941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fb697d6c-f687-49aa-ae21-0f625f8ee528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:25.255220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1003/1994] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:26.793038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:26.799398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:26.812806 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:26.822878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3cddd-42b8-48cb-9dc7-489a6b4611a5 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:26.828746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:26.829679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:26.830114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:26.830541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] PATH_INFO: `/v3/users/ac1e8a03fbfc4030b9ad88f82721906a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:26.831966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1e8a03fbfc4030b9ad88f82721906a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:26.834111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:26.906047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1e8a03fbfc4030b9ad88f82721906a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:26.927394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1e8a03fbfc4030b9ad88f82721906a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:26.943333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1e8a03fbfc4030b9ad88f82721906a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:26.944147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1e8a03fbfc4030b9ad88f82721906a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:26.958021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1e8a03fbfc4030b9ad88f82721906a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:26.968117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 992/1995] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:26 2022] DELETE /identity/v3/users/ac1e8a03fbfc4030b9ad88f82721906a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:26.969931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:26.970386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:26.970495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:26.980006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:26.995497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:26.996827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:27.079098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1004/1996] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:27.090263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:27.092159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:27.190802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9d749-e4e0-42be-82e9-be559fa4b299 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:27.196178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:27.196898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:27.197195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:27.197533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:27.211180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:27.223350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:27.232465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 993/1997] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:27.897058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:27.898573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:27.913538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629eab4-d862-4e35-b66d-757da3c1b3e2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:27.918005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:27.918671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:27.919820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:27.919820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] PATH_INFO: `/v3/projects/cb38d69e8f7f4e7dac40b651cf5ebbff` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:27.920481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb38d69e8f7f4e7dac40b651cf5ebbff)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:27.922439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:27.991103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb38d69e8f7f4e7dac40b651cf5ebbff', 'request_id': 'req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:27.999490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb38d69e8f7f4e7dac40b651cf5ebbff', 'request_id': 'req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.006914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb38d69e8f7f4e7dac40b651cf5ebbff', 'request_id': 'req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.028731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] The token cache is being invalidate because project cb38d69e8f7f4e7dac40b651cf5ebbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:28.028917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.029837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.031720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1005/1998] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:27 2022] DELETE /identity/v3/projects/cb38d69e8f7f4e7dac40b651cf5ebbff => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:28.035989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:28.047729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e5876-74e8-4702-b34f-e577183b14f7 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:28.176669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:28.179048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:28.179342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:28.179797 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] PATH_INFO: `/v3/users/2b3b6f8e7e2247638d4bfadf1d90a928` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:28.188605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b3b6f8e7e2247638d4bfadf1d90a928)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:28.191749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:28.226774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:28.277697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b3b6f8e7e2247638d4bfadf1d90a928'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.288476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b3b6f8e7e2247638d4bfadf1d90a928'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.299189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b3b6f8e7e2247638d4bfadf1d90a928'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.299957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b3b6f8e7e2247638d4bfadf1d90a928'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.329083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b3b6f8e7e2247638d4bfadf1d90a928'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:28.340410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 994/1999] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:28 2022] DELETE /identity/v3/users/2b3b6f8e7e2247638d4bfadf1d90a928 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:29.249215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:29.250933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:29.280428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45020a7e-b92d-4a87-82d7-cfb12c4bc67f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:29.363942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:29.364591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:29.364871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:29.365144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] PATH_INFO: `/v3/projects/a32978fed0444f048e6c4f9f377aed8f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:29.366408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a32978fed0444f048e6c4f9f377aed8f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:29.368432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:29.405997 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:29.422288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a32978fed0444f048e6c4f9f377aed8f', 'request_id': 'req-39dbfb89-d4d9-46b6-b0b2-924770a8c981'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.428201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a32978fed0444f048e6c4f9f377aed8f', 'request_id': 'req-39dbfb89-d4d9-46b6-b0b2-924770a8c981'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.434428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a32978fed0444f048e6c4f9f377aed8f', 'request_id': 'req-39dbfb89-d4d9-46b6-b0b2-924770a8c981'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.449379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] The token cache is being invalidate because project a32978fed0444f048e6c4f9f377aed8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:29.449674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.450314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.455548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1006/2000] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:29 2022] DELETE /identity/v3/projects/a32978fed0444f048e6c4f9f377aed8f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:29.456724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:29.458359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:29.470964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ce08d-78fa-41ed-9ffb-51f28a1fc1bf admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:29.528984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:29.529634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:29.529910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:29.530168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] PATH_INFO: `/v3/users/9b01abb221a445688235eb2c7dd3cf1b` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:29.531551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b01abb221a445688235eb2c7dd3cf1b)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:29.533587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:29.586893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b01abb221a445688235eb2c7dd3cf1b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.596022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b01abb221a445688235eb2c7dd3cf1b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.603932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b01abb221a445688235eb2c7dd3cf1b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.606341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b01abb221a445688235eb2c7dd3cf1b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.622660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-544c3d2b-ef05-4151-b5e0-34e2cd238771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b01abb221a445688235eb2c7dd3cf1b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:29.629689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 995/2001] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:29 2022] DELETE /identity/v3/users/9b01abb221a445688235eb2c7dd3cf1b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:29.961197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:29.962466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:29.984108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbfb89-d4d9-46b6-b0b2-924770a8c981 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.015607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d65f5-4870-40ab-b2a4-977cf8358dc7 None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.016249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d65f5-4870-40ab-b2a4-977cf8358dc7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.016728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d65f5-4870-40ab-b2a4-977cf8358dc7 None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.018701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 996/2002] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:48:30.065647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563f5e4-d8b4-4160-bd1d-f7bab30684e0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.066083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563f5e4-d8b4-4160-bd1d-f7bab30684e0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.066570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563f5e4-d8b4-4160-bd1d-f7bab30684e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.075760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.076519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.076874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.077209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] PATH_INFO: `/v3/projects/0018d1e6ee184c0cbb4686dac3f6d7b7` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.078697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0018d1e6ee184c0cbb4686dac3f6d7b7)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.080810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.102773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4563f5e4-d8b4-4160-bd1d-f7bab30684e0 None None] MFA Rules not processed for user `773a76b9319a4e18b1bcff3cb85d0a64`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:30.106919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4563f5e4-d8b4-4160-bd1d-f7bab30684e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.131847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:30.178500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0018d1e6ee184c0cbb4686dac3f6d7b7', 'request_id': 'req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.190399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0018d1e6ee184c0cbb4686dac3f6d7b7', 'request_id': 'req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.198009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0018d1e6ee184c0cbb4686dac3f6d7b7', 'request_id': 'req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.215917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] The token cache is being invalidate because project 0018d1e6ee184c0cbb4686dac3f6d7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:30.216285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.217261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.219422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1007/2003] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:29 2022] DELETE /identity/v3/projects/0018d1e6ee184c0cbb4686dac3f6d7b7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:30.220162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.221971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.242102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 997/2004] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:30.243330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.243758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.244099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.264183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:30.265457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.287735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:30.305552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497e3f-d052-4e5a-90f7-5ffd57e9b4ac admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.310963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.311683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.311962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.312231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] PATH_INFO: `/v3/users/763b11870ee642c5b4adc5a1cfd879f8` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.313364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763b11870ee642c5b4adc5a1cfd879f8)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.315367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.336568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 998/2005] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:30.337465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.346534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.385771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763b11870ee642c5b4adc5a1cfd879f8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.399951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763b11870ee642c5b4adc5a1cfd879f8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.408557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763b11870ee642c5b4adc5a1cfd879f8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.409570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763b11870ee642c5b4adc5a1cfd879f8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.422046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-842e748a-7d6f-482e-a2c4-30bc4890a370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763b11870ee642c5b4adc5a1cfd879f8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.428042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1008/2006] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:30 2022] DELETE /identity/v3/users/763b11870ee642c5b4adc5a1cfd879f8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:30.429251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.429524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.429785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.441553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb051e-8936-42f9-87f3-05138d9ac8f4 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.454397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:30.455756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.499839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:30.513607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.514464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.514771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.515046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.516922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.529918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.530842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1009/2007] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:30.531602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.535102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.545252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc2117-0748-4059-98e5-c49f3bb806a8 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.552367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.553483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.553808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.554080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.554824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:30.555121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.556922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.563649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 999/2008] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:30.575846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1010/2009] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:48:30.579951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.592218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fab4b-c59e-4094-be98-6332c82faf98 service placement] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.598209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.598956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.599977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.600563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.601354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.603582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.631462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.633326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.653959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1000/2010] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/projects => generated 407 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:30.658343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.660176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3664d8-bc68-40a4-8566-89432da82684 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.724290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:30.737491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.738216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.738495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.739051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] PATH_INFO: `/v3/projects/a8a7dec1117d44fbb1a176ca3171ea05` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.741125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a7dec1117d44fbb1a176ca3171ea05)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.743181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.744623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5438f3-126a-4afb-9d1c-20889463c7d9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.750099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.750726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.751117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.751407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.752033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.754136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.779223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1001/2011] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/users => generated 304 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:30.783190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.794592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458edc7f-a89b-46fe-8bd4-8ee688e0f85d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.794919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a7dec1117d44fbb1a176ca3171ea05', 'request_id': 'req-e9a7e595-58d6-4a52-af17-5f179b73bc41'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.802107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a7dec1117d44fbb1a176ca3171ea05', 'request_id': 'req-e9a7e595-58d6-4a52-af17-5f179b73bc41'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.810732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a7dec1117d44fbb1a176ca3171ea05', 'request_id': 'req-e9a7e595-58d6-4a52-af17-5f179b73bc41'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.828689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] The token cache is being invalidate because project a8a7dec1117d44fbb1a176ca3171ea05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:30.828996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.829652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e9a7e595-58d6-4a52-af17-5f179b73bc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:30.831212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1011/2012] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:30 2022] DELETE /identity/v3/projects/a8a7dec1117d44fbb1a176ca3171ea05 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:30.836081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c4c9-67f0-4579-9c9a-37afd1c315dd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.836456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c4c9-67f0-4579-9c9a-37afd1c315dd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.836718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30c4c9-67f0-4579-9c9a-37afd1c315dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.857444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8d30c4c9-67f0-4579-9c9a-37afd1c315dd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:30.859171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8d30c4c9-67f0-4579-9c9a-37afd1c315dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.867466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.868383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.868809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.869174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.869925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.871659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.883814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1002/2013] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:30.887756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.889925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.905142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a001e5-71ae-465c-b57d-01e5fc3021c0 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.911317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.912114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.912373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.912772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.913444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.915818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.926563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1003/2014] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:30.927003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1012/2015] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:30.931972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.935881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.936420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.936990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.942024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9320fe5-b2a2-4fb6-b67a-39f8b070b620 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.946812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041618fa-a3b1-4e6b-84a5-500de752bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:30.947502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041618fa-a3b1-4e6b-84a5-500de752bb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:30.947776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041618fa-a3b1-4e6b-84a5-500de752bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:30.948047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041618fa-a3b1-4e6b-84a5-500de752bb47 admin admin] PATH_INFO: `/v3/projects/d0c560c0a2ca40319d8c061e98995e5a/users/1f46ef8db87747cfa6e021b4425dc5b8/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:30.959883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:30.961367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:30.974371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041618fa-a3b1-4e6b-84a5-500de752bb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c560c0a2ca40319d8c061e98995e5a, user_id=1f46ef8db87747cfa6e021b4425dc5b8, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:30.977095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041618fa-a3b1-4e6b-84a5-500de752bb47 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:30.981093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1013/2016] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:30.982293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:30.994563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9ddfa-5a54-4d34-801b-5be32765587f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:30.996021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1004/2017] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:30 2022] PUT /identity/v3/projects/d0c560c0a2ca40319d8c061e98995e5a/users/1f46ef8db87747cfa6e021b4425dc5b8/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:31.008176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.008457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.008754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.035222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:31.038455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] MFA Rules not processed for user `1f46ef8db87747cfa6e021b4425dc5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:31.040702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:31.056164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.056781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.057060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.057329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.057977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:31.058279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.059922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.074467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1014/2018] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:31.079206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.092151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a150d7-3a8e-4021-b295-5e8d33ae0bf2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.102202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.103427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.103779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.105739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.105739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.107715 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.114474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1005/2019] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:31.115507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.125235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:31.127769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a66a2-1a49-4c2f-9bcf-8abef51be461 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.134029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.135263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.135517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.135868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.136602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.138564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.147788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1015/2020] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:31.152285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.173102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1006/2021] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/projects => generated 409 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:31.174284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.231642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8cf73-27a2-4669-b059-ce2f6c63020a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.248268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a8094-816c-4327-8394-ed5572f39446 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.252947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.253559 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.253823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.254189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.254912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.257107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.281745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1007/2022] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/users => generated 311 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:31.285804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.296050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da420ead-40d3-45b3-bf81-a26e033f7c50 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.296207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.296788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.297075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.297349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.297980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.299992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.303042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.303881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.304355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.304799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.305858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.307860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.319475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1008/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:31.324094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.329663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1016/2024] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:31.334875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173c4d2-f252-418b-81bb-dd43ab3726f6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.339093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.342582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.343531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.343903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.344268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] PATH_INFO: `/v3/projects/416e72b564794a81992697db7f439da6/users/7ce11a282f8d4f6785f6c5fa16dad9f1/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.350346 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe56a-28db-446d-9c93-527a2e77484d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.356109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.356720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.357001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.357270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.358262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.360749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.362054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=416e72b564794a81992697db7f439da6, user_id=7ce11a282f8d4f6785f6c5fa16dad9f1, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.365085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.372421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1017/2025] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:31.376208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.381334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1009/2026] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:31 2022] PUT /identity/v3/projects/416e72b564794a81992697db7f439da6/users/7ce11a282f8d4f6785f6c5fa16dad9f1/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:31.385196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.389989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733b05c-f7f9-4536-a7a0-f132975a4241 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.427964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:31.463620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c635f8-9d63-4ea5-8a07-f79af0580e13 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.466086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.466897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.467324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.468042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.468771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.470845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.476585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.477220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.477498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.477771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.479044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.481402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.483767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1018/2027] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:31.487530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.498322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1010/2028] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:31.500819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23148e2-89ff-45ca-9768-0079a3b5275d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.502525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.506076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ebcaf-e660-4d78-982a-49efe5c25ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.506886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ebcaf-e660-4d78-982a-49efe5c25ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.507275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ebcaf-e660-4d78-982a-49efe5c25ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.507641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ebcaf-e660-4d78-982a-49efe5c25ea5 admin admin] PATH_INFO: `/v3/projects/78443e418dc045788d18bad5eafbc441/users/a2d1814887704158a2eab952c058138a/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.513743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f52ff4-6bbe-46d4-b6e4-e44c5b032b2b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.519473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae555e8c-fa87-407c-902d-ac440f6a29be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.520456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae555e8c-fa87-407c-902d-ac440f6a29be admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.520744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae555e8c-fa87-407c-902d-ac440f6a29be admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.521017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae555e8c-fa87-407c-902d-ac440f6a29be admin admin] PATH_INFO: `/v3/projects/416e72b564794a81992697db7f439da6/users/7ce11a282f8d4f6785f6c5fa16dad9f1/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.521260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:31.523832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae555e8c-fa87-407c-902d-ac440f6a29be admin admin] RBAC: Authorizing `identity:create_grant(project_id=416e72b564794a81992697db7f439da6, user_id=7ce11a282f8d4f6785f6c5fa16dad9f1, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.528252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ebcaf-e660-4d78-982a-49efe5c25ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78443e418dc045788d18bad5eafbc441, user_id=a2d1814887704158a2eab952c058138a, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.531045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ebcaf-e660-4d78-982a-49efe5c25ea5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.532667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae555e8c-fa87-407c-902d-ac440f6a29be admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.546144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1011/2029] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:31 2022] PUT /identity/v3/projects/416e72b564794a81992697db7f439da6/users/7ce11a282f8d4f6785f6c5fa16dad9f1/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:31.564324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1019/2030] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:31 2022] PUT /identity/v3/projects/78443e418dc045788d18bad5eafbc441/users/a2d1814887704158a2eab952c058138a/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:31.564527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.564527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.564527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.565996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.566284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.568692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.595276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] MFA Rules not processed for user `7ce11a282f8d4f6785f6c5fa16dad9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:31.597598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:31.599535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] MFA Rules not processed for user `a2d1814887704158a2eab952c058138a`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:31.602595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:31.679306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1020/2031] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:31.686719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1012/2032] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:31 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:31.691828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.693589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:31.695804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.697343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:31.755274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3ccde-8223-4ff0-aa66-a13082c8e51b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.759272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.759974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.760320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.760650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.770906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.771062 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c328ea-1cf9-434b-9fdb-16b9c46165dd None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.773009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.776551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.777154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.777429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.777697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:31.783479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1013/2033] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:31.785622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:31.787252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:31.797168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1021/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:31.952145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:31.961889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb9f7-3ab9-416f-80dd-5d71702cc30d service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:31.965736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ff466-218d-4f5e-a2d3-783310ad4ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:31.966356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ff466-218d-4f5e-a2d3-783310ad4ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:31.966617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ff466-218d-4f5e-a2d3-783310ad4ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:31.966963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ff466-218d-4f5e-a2d3-783310ad4ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:32.018953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:32.033584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ff466-218d-4f5e-a2d3-783310ad4ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:32.035277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ff466-218d-4f5e-a2d3-783310ad4ef4 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:32.045433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1014/2035] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:31 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:38.158919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:38.222775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb6425-2990-4c71-9693-0352ce191f29 service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:38.227549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:38.228175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.228447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.228701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] PATH_INFO: `/v3/users/a2d1814887704158a2eab952c058138a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.229835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d1814887704158a2eab952c058138a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:38.231823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:38.236708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:38.288582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d1814887704158a2eab952c058138a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.298937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d1814887704158a2eab952c058138a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.307907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d1814887704158a2eab952c058138a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.308617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d1814887704158a2eab952c058138a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.323285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d1814887704158a2eab952c058138a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.332013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1022/2036] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:38 2022] DELETE /identity/v3/users/a2d1814887704158a2eab952c058138a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:38.336286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.336796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.336905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.364505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:38.366009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:38.438037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1015/2037] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:38.447621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:38.449154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:38.458361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:38.459948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:38.472080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f95ea-2ce5-4cb9-bb4b-93bb5de0edbc None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:38.477000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:38.477681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.477941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.478314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] PATH_INFO: `/v3/users/1f46ef8db87747cfa6e021b4425dc5b8` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.479408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f46ef8db87747cfa6e021b4425dc5b8)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:38.481389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:38.506375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583e560-4758-416c-86e5-9766d4c50045 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:38.510180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f1494-5dc3-49d2-b3fc-c9fd25d5ccba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:38.510847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1494-5dc3-49d2-b3fc-c9fd25d5ccba service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.511113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1494-5dc3-49d2-b3fc-c9fd25d5ccba service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.511382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f1494-5dc3-49d2-b3fc-c9fd25d5ccba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.521186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f1494-5dc3-49d2-b3fc-c9fd25d5ccba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:38.522740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f1494-5dc3-49d2-b3fc-c9fd25d5ccba service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:38.530208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f46ef8db87747cfa6e021b4425dc5b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.534260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1023/2038] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:38.538082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f46ef8db87747cfa6e021b4425dc5b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.548476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f46ef8db87747cfa6e021b4425dc5b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.549607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f46ef8db87747cfa6e021b4425dc5b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.563608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f46ef8db87747cfa6e021b4425dc5b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.570458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1016/2039] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:38 2022] DELETE /identity/v3/users/1f46ef8db87747cfa6e021b4425dc5b8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:38.575185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.575391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.575713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.596606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:38.597877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:38.670327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1024/2040] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:38.685572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:38.687271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:38.759060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4df25-740d-4b3e-bdb0-590506c5272e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:38.762586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfcebfb-e478-4db8-bd8b-d1e7369408cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:38.763232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcebfb-e478-4db8-bd8b-d1e7369408cd service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.763496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcebfb-e478-4db8-bd8b-d1e7369408cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.763769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfcebfb-e478-4db8-bd8b-d1e7369408cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.773642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcebfb-e478-4db8-bd8b-d1e7369408cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:38.775112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfcebfb-e478-4db8-bd8b-d1e7369408cd service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:38.780969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:38.786767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1017/2041] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:38.865495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:38.866990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:38.879266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89ebf9-3c10-4e45-b487-7f3d0fa7342f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:38.884397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:38.885061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.885453 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.885586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] PATH_INFO: `/v3/projects/78443e418dc045788d18bad5eafbc441` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:38.886818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78443e418dc045788d18bad5eafbc441)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:38.888744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:38.919682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:38.948150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78443e418dc045788d18bad5eafbc441', 'request_id': 'req-def178bc-feee-457b-b6b6-2e534a4e08b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.953873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78443e418dc045788d18bad5eafbc441', 'request_id': 'req-def178bc-feee-457b-b6b6-2e534a4e08b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.960587 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78443e418dc045788d18bad5eafbc441', 'request_id': 'req-def178bc-feee-457b-b6b6-2e534a4e08b2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.980939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] The token cache is being invalidate because project 78443e418dc045788d18bad5eafbc441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:38.981232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.981903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-def178bc-feee-457b-b6b6-2e534a4e08b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:38.983619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1025/2042] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:38 2022] DELETE /identity/v3/projects/78443e418dc045788d18bad5eafbc441 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:38.988525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:38.988877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:38.989381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.009799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:39.011041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.087610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1018/2043] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:39.095207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.095789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.096230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.118775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:39.120174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.125403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.127188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.136706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1026/2044] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:39.140467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.152993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5003567-39f3-4033-acb5-d82575d015e7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.153461 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902ea9c-575d-4b72-982e-6b1928a963f4 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.158515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.159142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.159676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.159970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.160551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:39.160851 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.162481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.165650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.166293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.166569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.166927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] PATH_INFO: `/v3/projects/d0c560c0a2ca40319d8c061e98995e5a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.168119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c560c0a2ca40319d8c061e98995e5a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.169994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.175559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1027/2045] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:39.180910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.192549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d6404-008e-43fb-8e15-78c2c49a3898 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.199773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.200243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.200488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.200911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.201749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.203796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.225758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c560c0a2ca40319d8c061e98995e5a', 'request_id': 'req-6c895325-564d-4137-9113-711ff8c74b91'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.234730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c560c0a2ca40319d8c061e98995e5a', 'request_id': 'req-6c895325-564d-4137-9113-711ff8c74b91'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.239815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1028/2046] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:39.244056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.246066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c560c0a2ca40319d8c061e98995e5a', 'request_id': 'req-6c895325-564d-4137-9113-711ff8c74b91'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.263544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] The token cache is being invalidate because project d0c560c0a2ca40319d8c061e98995e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:39.263839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.264820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.266234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1019/2047] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:39 2022] DELETE /identity/v3/projects/d0c560c0a2ca40319d8c061e98995e5a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:39.270114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.271455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.314593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb77e9d-9a9f-4056-b1b5-f51258ac8ce9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.319237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.319882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.320119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.320382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.321003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.323532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.338068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895325-564d-4137-9113-711ff8c74b91 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.342702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.343327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.343605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.343878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] PATH_INFO: `/v3/users/7ce11a282f8d4f6785f6c5fa16dad9f1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.345012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce11a282f8d4f6785f6c5fa16dad9f1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.348432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1029/2048] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:39.348543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.349720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.351370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.363300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44bd13-c605-4766-8404-c050c9ff8c36 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.367896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.368483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.368755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.369020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.369655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.371408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.377704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:39.382198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1030/2049] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:39.395487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.400337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce11a282f8d4f6785f6c5fa16dad9f1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.405978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300cca4-f1d8-4cad-ac97-135119f41b47 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.410192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce11a282f8d4f6785f6c5fa16dad9f1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.410729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.411442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.411700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.411960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.412685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.414363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.418963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce11a282f8d4f6785f6c5fa16dad9f1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.419812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce11a282f8d4f6785f6c5fa16dad9f1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.427751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1031/2050] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:39.432113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.434215 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.437758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-fa22fac6-4cbf-46c3-87e9-4088588a5b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce11a282f8d4f6785f6c5fa16dad9f1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.447181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1020/2051] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:39 2022] DELETE /identity/v3/users/7ce11a282f8d4f6785f6c5fa16dad9f1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:39.447352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d06aaa-4807-4d47-ae72-1be7b55346f8 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.487932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:39.529605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.530293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.530766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.531125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] PATH_INFO: `/v3/projects/cf0115519132413f828820a17fe96c40/users/ecb923c579834e7d874f1f36702797be/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.558131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf0115519132413f828820a17fe96c40, user_id=ecb923c579834e7d874f1f36702797be, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.564481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.579817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1032/2052] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:39 2022] PUT /identity/v3/projects/cf0115519132413f828820a17fe96c40/users/ecb923c579834e7d874f1f36702797be/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:39.591391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.591674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.591944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.624979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] MFA Rules not processed for user `ecb923c579834e7d874f1f36702797be`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:39.626600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.698232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1021/2053] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:39.702498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.754955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.757972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:39.773815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec9c9-0ef8-4f53-af2f-b5b56eb0a9a3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.779130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.779755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.780031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.780297 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.781535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.783816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.818081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1033/2054] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:39.822027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.833157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a27b0-4826-49de-a4a4-1cb4bfcb4904 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.875433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:39.898054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.898718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.898998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.899269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] PATH_INFO: `/v3/projects/416e72b564794a81992697db7f439da6` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.900404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=416e72b564794a81992697db7f439da6)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.902503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.907460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2bbda-597d-4d52-ac43-272f547ed9bd admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.913304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:39.913917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:39.914200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:39.914629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:39.915182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:39.917145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:39.939724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1034/2055] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:39.943596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:39.953037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416e72b564794a81992697db7f439da6', 'request_id': 'req-2f223c19-91a4-48e5-a887-f6b2af3c6016'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.953781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e6660-1c8a-47a3-8a36-5bd0bf81063e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:39.958753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416e72b564794a81992697db7f439da6', 'request_id': 'req-2f223c19-91a4-48e5-a887-f6b2af3c6016'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.965993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416e72b564794a81992697db7f439da6', 'request_id': 'req-2f223c19-91a4-48e5-a887-f6b2af3c6016'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.990244 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] The token cache is being invalidate because project 416e72b564794a81992697db7f439da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:39.990543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.991278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-2f223c19-91a4-48e5-a887-f6b2af3c6016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:39.992332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:39.994361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1022/2056] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:39 2022] DELETE /identity/v3/projects/416e72b564794a81992697db7f439da6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:40.000851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.000991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.001173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.020472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed587a-8999-4c7d-880b-d5768ca95339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.021105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed587a-8999-4c7d-880b-d5768ca95339 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.021377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed587a-8999-4c7d-880b-d5768ca95339 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.021672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed587a-8999-4c7d-880b-d5768ca95339 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.022313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed587a-8999-4c7d-880b-d5768ca95339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.022491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:40.023770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.023954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed587a-8999-4c7d-880b-d5768ca95339 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.032459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1023/2057] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:40.036945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1035/2058] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:40.039684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.040986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.041195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.041483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.041754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.053124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa306c-fcc7-4e3b-a3ab-0e1002a47052 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.057682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.058400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.058673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.058973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] PATH_INFO: `/v3/projects/47eb4101e8ea4f34aa69b38d8a0e3711/users/135d77908ce64a3683f873af19af782c/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.062027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:40.063269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.071262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1036/2059] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:40.073191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eb4101e8ea4f34aa69b38d8a0e3711, user_id=135d77908ce64a3683f873af19af782c, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.075611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.075979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.084893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac1829-94e9-49c2-ac7e-dc436b193905 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.090280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1024/2060] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:40 2022] PUT /identity/v3/projects/47eb4101e8ea4f34aa69b38d8a0e3711/users/135d77908ce64a3683f873af19af782c/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:40.094257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.147600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.148357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.148709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.148998 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.149768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:40.150442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.152552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.163034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06680-1379-48b6-956c-6b3e48ef1c2a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.169293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1037/2061] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:48:40.169887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.169887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.169887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.169887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.170191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.170431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.171800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.181431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bca95-41e3-47c1-91e4-b99f5eebbd76 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.184618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1025/2062] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:40.186503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.187157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.187436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.187968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.188337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.188919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.190352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.201594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e412a22-8e9a-4f5d-ba82-0843d48d4578 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.206945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e49170-21c4-49f9-8990-209b5cdf4871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.207579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49170-21c4-49f9-8990-209b5cdf4871 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.207857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49170-21c4-49f9-8990-209b5cdf4871 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.208127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e49170-21c4-49f9-8990-209b5cdf4871 admin admin] PATH_INFO: `/v3/projects/47eb4101e8ea4f34aa69b38d8a0e3711/users/135d77908ce64a3683f873af19af782c/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.210221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e49170-21c4-49f9-8990-209b5cdf4871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47eb4101e8ea4f34aa69b38d8a0e3711, user_id=135d77908ce64a3683f873af19af782c, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.213819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e49170-21c4-49f9-8990-209b5cdf4871 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.224107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1038/2063] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:40 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:40.225127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.225618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1026/2064] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:40 2022] PUT /identity/v3/projects/47eb4101e8ea4f34aa69b38d8a0e3711/users/135d77908ce64a3683f873af19af782c/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:40.235807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.236101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.236377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.264707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] MFA Rules not processed for user `135d77908ce64a3683f873af19af782c`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:40.265935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.275938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:40.292109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a33ae-d351-4df5-9d61-ae337f034139 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.340939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:40.351477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1027/2065] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:40.361680 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.363093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.363376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.363644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.363765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.365245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.365348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.367261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.393785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1039/2066] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:40 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:40.398118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.411027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7d6f6-95b0-40a7-a3e0-550aba79ff85 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.416814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.417494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.418162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.418445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.419149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.421064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.431773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1040/2067] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:40.435287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfd63c-724a-4af2-a57a-a9d982b54a69 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.436671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.439945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.441062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.441544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.441950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.447019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6394bf-9000-44b4-81b5-c6a6a5cbd423 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.451417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.452549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.452848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.453154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.453438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.453704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.454352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.456015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.463798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1028/2068] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:40.467657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1041/2069] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:40.472033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.482991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f12e96-74ce-4e0d-a0db-f71fa6b439dd service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.488504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b458bf9-e3f6-44f6-9cbc-2b8239edd905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.490580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458bf9-e3f6-44f6-9cbc-2b8239edd905 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.490580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458bf9-e3f6-44f6-9cbc-2b8239edd905 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.490580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458bf9-e3f6-44f6-9cbc-2b8239edd905 admin admin] PATH_INFO: `/v3/projects/c63e2fcc50c748209e34d9d9fdbb36de/users/a71b1fd0542440148963958053da3d0d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.492148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.502581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7466443-a3a1-47dc-bc2d-8d739c6534d9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.506165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458bf9-e3f6-44f6-9cbc-2b8239edd905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63e2fcc50c748209e34d9d9fdbb36de, user_id=a71b1fd0542440148963958053da3d0d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.507700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.508516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.508792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.508899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458bf9-e3f6-44f6-9cbc-2b8239edd905 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.509057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] PATH_INFO: `/v3/users/ecb923c579834e7d874f1f36702797be` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.510308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb923c579834e7d874f1f36702797be)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.512374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.525121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1029/2070] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:40 2022] PUT /identity/v3/projects/c63e2fcc50c748209e34d9d9fdbb36de/users/a71b1fd0542440148963958053da3d0d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:40.535971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.536264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.536534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.562621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb923c579834e7d874f1f36702797be'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:40.567936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] MFA Rules not processed for user `a71b1fd0542440148963958053da3d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:40.569171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.570696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb923c579834e7d874f1f36702797be'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:40.583389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb923c579834e7d874f1f36702797be'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:40.584060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb923c579834e7d874f1f36702797be'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:40.604845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-119dcb73-6c5e-4b0d-b903-8f3d0b4d0679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb923c579834e7d874f1f36702797be'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:40.613576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1042/2071] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:40 2022] DELETE /identity/v3/users/ecb923c579834e7d874f1f36702797be => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:40.618421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.618421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.618618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.640612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:40.641935 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.648326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1030/2072] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:40.660241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.661890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.683051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:40.711045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1043/2073] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:40.720772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:40.722845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:40.731286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46a7d-c759-4b54-b8e5-19caf7a97c43 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.749060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:40.789922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d67b37-0563-44cd-90d4-c4a7baccbf53 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:40.792694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.793364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.793635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.793907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.795895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:40.796433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:40.796712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:40.796979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:40.807043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.809165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.821377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1044/2074] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:40.854784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:40.856335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:40.866159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1031/2075] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:41.171027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:41.172915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:41.187286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb7196-fdea-4a19-a83e-a7de22e294f9 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:41.197503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:41.199186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:41.199465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:41.199760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] PATH_INFO: `/v3/projects/cf0115519132413f828820a17fe96c40` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:41.203952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf0115519132413f828820a17fe96c40)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:41.206005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:41.277902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf0115519132413f828820a17fe96c40', 'request_id': 'req-0e06db7b-7a80-4975-8f7c-774f67ae632b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.284196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf0115519132413f828820a17fe96c40', 'request_id': 'req-0e06db7b-7a80-4975-8f7c-774f67ae632b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.291514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf0115519132413f828820a17fe96c40', 'request_id': 'req-0e06db7b-7a80-4975-8f7c-774f67ae632b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.305485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] The token cache is being invalidate because project cf0115519132413f828820a17fe96c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:41.305773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.306413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.308067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1045/2076] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:41 2022] DELETE /identity/v3/projects/cf0115519132413f828820a17fe96c40 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:41.318663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:41.330393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4f53-7085-475a-a662-1f08192c7179 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:41.386236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:41.387098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:41.387185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:41.387437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] PATH_INFO: `/v3/users/135d77908ce64a3683f873af19af782c` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:41.388627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135d77908ce64a3683f873af19af782c)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:41.390892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:41.421222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:41.441259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135d77908ce64a3683f873af19af782c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.457852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135d77908ce64a3683f873af19af782c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.466284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135d77908ce64a3683f873af19af782c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.467107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135d77908ce64a3683f873af19af782c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.485413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-557b20e4-d851-4fec-ae0f-656c33bd2a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135d77908ce64a3683f873af19af782c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.492679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1032/2077] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:41 2022] DELETE /identity/v3/users/135d77908ce64a3683f873af19af782c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:41.851021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:41.852524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:41.867302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06db7b-7a80-4975-8f7c-774f67ae632b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:41.934516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:41.935237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:41.935506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:41.935768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] PATH_INFO: `/v3/projects/47eb4101e8ea4f34aa69b38d8a0e3711` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:41.937112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47eb4101e8ea4f34aa69b38d8a0e3711)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:41.939088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:41.990030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47eb4101e8ea4f34aa69b38d8a0e3711', 'request_id': 'req-532c9de5-b94c-4cc0-80cd-4c283df3043a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:41.991233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:41.996743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47eb4101e8ea4f34aa69b38d8a0e3711', 'request_id': 'req-532c9de5-b94c-4cc0-80cd-4c283df3043a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:42.004298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47eb4101e8ea4f34aa69b38d8a0e3711', 'request_id': 'req-532c9de5-b94c-4cc0-80cd-4c283df3043a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:42.016300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] The token cache is being invalidate because project 47eb4101e8ea4f34aa69b38d8a0e3711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:42.016576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:42.017242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-532c9de5-b94c-4cc0-80cd-4c283df3043a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:42.019222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1046/2078] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:41 2022] DELETE /identity/v3/projects/47eb4101e8ea4f34aa69b38d8a0e3711 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:42.024257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.024551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.024823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.047531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:42.048760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:42.108969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1033/2079] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:42.118895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.119176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.119446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.141231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:42.142599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:42.151773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1047/2080] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:42.156423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.168375 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8a732-8e2e-4941-a9c5-62eb7e49ed32 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.173484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.174177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.174454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.174750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.175403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:42.175705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.177320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.190711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1034/2081] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:48:42.194814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.204408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0460d80-6e28-49f4-a7ce-c7fa9aeb05a2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.209049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.209646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.209920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.210212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.210905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.212808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.242574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1048/2082] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:42.247682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.266632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f4da1-144d-4a02-8237-dba25b44bdce admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.341328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.341910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.342182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.342451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.343127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.345035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.368776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1035/2083] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:42.369941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.380366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132dd061-fd6e-4e95-8d05-492daff119c0 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.384980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.385598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.385862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.386116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.386817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.388397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.400598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1049/2084] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:42.404657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.415132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc84294-fb95-4c4b-ad65-da2260029f7d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.420070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41914b-f87f-41ea-b8d5-7bb735ffe758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.420666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41914b-f87f-41ea-b8d5-7bb735ffe758 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.420947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41914b-f87f-41ea-b8d5-7bb735ffe758 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.421219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41914b-f87f-41ea-b8d5-7bb735ffe758 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.421855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41914b-f87f-41ea-b8d5-7bb735ffe758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.423505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41914b-f87f-41ea-b8d5-7bb735ffe758 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.434666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1036/2085] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:42.439024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.449777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d567df-dda5-472b-939d-b2654b6cf480 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.454749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.455490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.455836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.456127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] PATH_INFO: `/v3/projects/2334aea2197446088bc9cabc439ea243/users/d1c9cbc0b5f34a1ea2c352226cac756d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.477240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2334aea2197446088bc9cabc439ea243, user_id=d1c9cbc0b5f34a1ea2c352226cac756d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.479583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.498094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1050/2086] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:42 2022] PUT /identity/v3/projects/2334aea2197446088bc9cabc439ea243/users/d1c9cbc0b5f34a1ea2c352226cac756d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:42.508345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.508729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.509009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.530519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:42.539479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] MFA Rules not processed for user `d1c9cbc0b5f34a1ea2c352226cac756d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:42.542465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:42.622397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1037/2087] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:42.627224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.715789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1858f96-7aa6-4834-adb4-bec332f987a7 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.721444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.722152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.722613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.722898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.723527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.727399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.760944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1051/2088] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:42.765351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.778167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0ca3e-556f-4b2d-b57d-241475387ceb None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.848858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.849400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.849831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.850167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.850851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.852847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.881590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1038/2089] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:42 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:42.882319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.893084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915cfb9-9ec6-4564-8405-8c303afc9992 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.898584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.899234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.899511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.899850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.900498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.902173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.914358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1052/2090] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:42.918575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.929005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21486a18-956e-480c-88ac-0590988ee89b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:42.934838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:42.934838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:42.934838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:42.935176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] PATH_INFO: `/v3/projects/c50e4ba014f14fd2a81fe8777fa348ba/users/44ccff4cc1a6475b83f98ad34fcef83f/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:42.950450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50e4ba014f14fd2a81fe8777fa348ba, user_id=44ccff4cc1a6475b83f98ad34fcef83f, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:42.953120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:42.975175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1039/2091] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:42 2022] PUT /identity/v3/projects/c50e4ba014f14fd2a81fe8777fa348ba/users/44ccff4cc1a6475b83f98ad34fcef83f/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:42.980595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:42.991359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598f78-08fc-427b-aa8f-227031bf0025 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:43.038471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:43.052471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6afbf-a8ff-4d1c-860b-291a79ab77dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:43.052869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6afbf-a8ff-4d1c-860b-291a79ab77dd admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.053148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6afbf-a8ff-4d1c-860b-291a79ab77dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.053417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6afbf-a8ff-4d1c-860b-291a79ab77dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:43.054065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6afbf-a8ff-4d1c-860b-291a79ab77dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:43.055717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6afbf-a8ff-4d1c-860b-291a79ab77dd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:43.066099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1053/2092] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:43.071141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:43.082119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947b265-ad6b-49d5-b972-202da6f6216c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:43.086956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:43.087604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.087881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.088154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] PATH_INFO: `/v3/projects/c50e4ba014f14fd2a81fe8777fa348ba/users/44ccff4cc1a6475b83f98ad34fcef83f/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:43.090071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c50e4ba014f14fd2a81fe8777fa348ba, user_id=44ccff4cc1a6475b83f98ad34fcef83f, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:43.092742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:43.104964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1040/2093] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:43 2022] PUT /identity/v3/projects/c50e4ba014f14fd2a81fe8777fa348ba/users/44ccff4cc1a6475b83f98ad34fcef83f/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:43.115643 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.115929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.116229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:43.144744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] MFA Rules not processed for user `44ccff4cc1a6475b83f98ad34fcef83f`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:43.145976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:43.213414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1054/2094] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:43.224615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:43.226404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:43.288306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d90cd-c05e-43e0-b626-43dc4a284ccd admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:43.291986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:43.292916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.293173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.293438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:43.300872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:43.303253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:43.305065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:43.317087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1041/2095] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:43.435624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:43.445570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8303ee-b66e-41d3-ae96-1e4244a200e6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:43.449409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81565c98-4895-4a94-b750-0fe912c08f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:43.450007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81565c98-4895-4a94-b750-0fe912c08f04 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.450278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81565c98-4895-4a94-b750-0fe912c08f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.450543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81565c98-4895-4a94-b750-0fe912c08f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:43.508953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81565c98-4895-4a94-b750-0fe912c08f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:43.510467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81565c98-4895-4a94-b750-0fe912c08f04 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:43.519760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1055/2096] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:43.747439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:43.748920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:43.835883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27741a68-87c0-47f1-9c38-a009dd5d7a59 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:43.842112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:43.843110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.843453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.843834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] PATH_INFO: `/v3/users/19368d54f71549278f3cf287b01610b1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:43.845862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19368d54f71549278f3cf287b01610b1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:43.848596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:43.914096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19368d54f71549278f3cf287b01610b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:43.926030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19368d54f71549278f3cf287b01610b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:43.938698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19368d54f71549278f3cf287b01610b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:43.939677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19368d54f71549278f3cf287b01610b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:43.956747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19368d54f71549278f3cf287b01610b1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:43.972062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1042/2097] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:43 2022] DELETE /identity/v3/users/19368d54f71549278f3cf287b01610b1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:43.976511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:43.976800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:43.977037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.000510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:44.001344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.068268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1056/2098] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:44.083120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.084728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.146020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9731d3-d2fd-43df-b6f6-c9d95a03a69b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.150027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1135f-dd70-4f32-a1b2-c0afe9e61371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.150714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1135f-dd70-4f32-a1b2-c0afe9e61371 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.151039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1135f-dd70-4f32-a1b2-c0afe9e61371 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.151287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1135f-dd70-4f32-a1b2-c0afe9e61371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.163699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1135f-dd70-4f32-a1b2-c0afe9e61371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.165281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1135f-dd70-4f32-a1b2-c0afe9e61371 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.167250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.169130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.175759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1043/2099] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:44.184351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaff79a-5a74-42c4-b2c4-5359d242f654 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.189761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.190412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.190709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.190994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] PATH_INFO: `/v3/users/a71b1fd0542440148963958053da3d0d` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.192172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71b1fd0542440148963958053da3d0d)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.194130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.196962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:44.271184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71b1fd0542440148963958053da3d0d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.287819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71b1fd0542440148963958053da3d0d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.316554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71b1fd0542440148963958053da3d0d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.316845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71b1fd0542440148963958053da3d0d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.340838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71b1fd0542440148963958053da3d0d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.349285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1057/2100] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:44 2022] DELETE /identity/v3/users/a71b1fd0542440148963958053da3d0d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:44.354058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.354539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.354966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.378983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:44.380108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.394732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:44.455055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1044/2101] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:44.465369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.467063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.539032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbc3d0-034b-47ae-9461-fc860e1ce04d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.544899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec7801-657c-4504-a69f-3b464eec97b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.545694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec7801-657c-4504-a69f-3b464eec97b8 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.546128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec7801-657c-4504-a69f-3b464eec97b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.546474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec7801-657c-4504-a69f-3b464eec97b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.558756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec7801-657c-4504-a69f-3b464eec97b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.560187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec7801-657c-4504-a69f-3b464eec97b8 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.571773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.572512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1058/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:44.575529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.588382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5a70-2a91-4231-9d4d-a04a3baa622c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.593291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.593934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.594304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.594471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] PATH_INFO: `/v3/projects/2162773ffb404fc7891d7649976153c2` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.595636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2162773ffb404fc7891d7649976153c2)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.597546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.659170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2162773ffb404fc7891d7649976153c2', 'request_id': 'req-e231b793-f2d2-4755-a091-e790fc37c616'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.667861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2162773ffb404fc7891d7649976153c2', 'request_id': 'req-e231b793-f2d2-4755-a091-e790fc37c616'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.675694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2162773ffb404fc7891d7649976153c2', 'request_id': 'req-e231b793-f2d2-4755-a091-e790fc37c616'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.695589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] The token cache is being invalidate because project 2162773ffb404fc7891d7649976153c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:44.695907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.696597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e231b793-f2d2-4755-a091-e790fc37c616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:44.699105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1045/2103] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:44 2022] DELETE /identity/v3/projects/2162773ffb404fc7891d7649976153c2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:44.703602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.703902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.704282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.723677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:44.724898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.786592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1059/2104] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:44.794510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.795000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.795117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.815194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:44.816406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.824483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1046/2105] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:44.828910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.840429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b8c1f-f3a6-4946-9b40-48689aaed4e9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.846197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.846831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.847106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.847369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.848014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:44.848306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.849991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.863180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1060/2106] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:44.868120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.878392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:44.880869 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:44.897607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013481c-dafc-41ec-8612-158b38717b57 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.898451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef26854-8f31-44da-adf3-c8dd5b7c51e5 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:44.905784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.906847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.907511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.908087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] PATH_INFO: `/v3/projects/c63e2fcc50c748209e34d9d9fdbb36de` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.908212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:44.909489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:44.910142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:44.910818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:44.911228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63e2fcc50c748209e34d9d9fdbb36de)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.912097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:44.914365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.914728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:44.923064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:44.961391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1047/2107] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:44 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:44.968188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.008059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63e2fcc50c748209e34d9d9fdbb36de', 'request_id': 'req-fb939908-4b38-4620-a1e5-f6f1d35005af'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:45.033431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63e2fcc50c748209e34d9d9fdbb36de', 'request_id': 'req-fb939908-4b38-4620-a1e5-f6f1d35005af'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:45.041591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63e2fcc50c748209e34d9d9fdbb36de', 'request_id': 'req-fb939908-4b38-4620-a1e5-f6f1d35005af'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:45.060912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] The token cache is being invalidate because project c63e2fcc50c748209e34d9d9fdbb36de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:45.061425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:45.062208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fb939908-4b38-4620-a1e5-f6f1d35005af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:45.066716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1061/2108] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:44 2022] DELETE /identity/v3/projects/c63e2fcc50c748209e34d9d9fdbb36de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:45.069134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2ce2-b433-4c4b-9760-671480edf602 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.069433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2ce2-b433-4c4b-9760-671480edf602 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.069697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2ce2-b433-4c4b-9760-671480edf602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.074855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8353d019-aed0-4a08-8017-c56775851bd4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.093060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-780c2ce2-b433-4c4b-9760-671480edf602 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:45.094255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-780c2ce2-b433-4c4b-9760-671480edf602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.102912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:45.165005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.165708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.166049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.166388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.167290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.171343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.195033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1062/2109] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:45.195033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c350-243e-4571-aa4a-fe4bf17c3bf4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.195033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c350-243e-4571-aa4a-fe4bf17c3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.195033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c350-243e-4571-aa4a-fe4bf17c3bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.207170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1048/2110] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:44 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:45.211888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.212559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f6f6c350-243e-4571-aa4a-fe4bf17c3bf4 None None] MFA Rules not processed for user `d74cbd6d82c84a1294af1af356d3d93a`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:45.213771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f6f6c350-243e-4571-aa4a-fe4bf17c3bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.215905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.229726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d16786-04dd-42c5-aec5-357393f81b46 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.235261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.235906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.236155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.236568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.237367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.246384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.257839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1049/2111] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:45.262302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.272839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825e2ce-ef41-48b4-93e7-61c578eb6fc6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.277588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.278199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.278476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.278858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.279680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.280909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1063/2112] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:45.281420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.288268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.288557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.288829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.294861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1050/2113] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:45.300599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.311119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a36d76-e1b3-4660-bf9e-4dcabdff18d7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.315718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:45.316452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ad94e-d532-452c-923b-faca369d5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.317144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ad94e-d532-452c-923b-faca369d5a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.317253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.317423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ad94e-d532-452c-923b-faca369d5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.317698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ad94e-d532-452c-923b-faca369d5a0c admin admin] PATH_INFO: `/v3/projects/3609612b368c4c3e941e12ec04bf3744/users/75172e2c3a9a425fa5a1070a0926fdb3/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.326016 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1064/2114] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:45.330978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.334851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ad94e-d532-452c-923b-faca369d5a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3609612b368c4c3e941e12ec04bf3744, user_id=75172e2c3a9a425fa5a1070a0926fdb3, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.338249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ad94e-d532-452c-923b-faca369d5a0c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.343047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d794ae-462a-41ae-b73f-c320704112fc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.348472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.349224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.349370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.349639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.350287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:45.350589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.352224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.354714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1051/2115] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:45 2022] PUT /identity/v3/projects/3609612b368c4c3e941e12ec04bf3744/users/75172e2c3a9a425fa5a1070a0926fdb3/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:45.364499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.364693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1065/2116] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:45.365610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.365610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.369785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.380152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daa864-8c38-42e6-9989-68c8703e0ea2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.401366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:45.403730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] MFA Rules not processed for user `75172e2c3a9a425fa5a1070a0926fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:45.405680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.450541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.451101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.451382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.451654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.452291 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.454200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.491051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1052/2117] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:45.491203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1066/2118] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:45.492186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.499548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.502177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.504711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f031a-fd39-4a2b-afd9-2606b79c4f56 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.556725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:45.568544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d0b67-f971-4635-8a5c-e6122fdaa34d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.572114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.572723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.572995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.573257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.574303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.575054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.575388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.575723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.576421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.579333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.605397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1053/2119] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:45.609654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.619399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc1e2-abe4-457c-9df2-25100735be67 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.624914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.625537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.625811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.626074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.626738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.628968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.638258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.639744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.640938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1054/2120] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:45.645196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.652142 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1067/2121] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:45.655154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1e5e8-5168-41c2-9da7-0f627e130f6e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.660199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e82f2b-34d3-415a-915d-481a90020b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.660796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82f2b-34d3-415a-915d-481a90020b89 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.661149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82f2b-34d3-415a-915d-481a90020b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.661553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e82f2b-34d3-415a-915d-481a90020b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.662204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e82f2b-34d3-415a-915d-481a90020b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.663835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e82f2b-34d3-415a-915d-481a90020b89 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.675510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1055/2122] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:45.679575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.691872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408bcb-163c-49af-b1ca-76985fadc4e3 service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:45.696537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:45.697673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.697673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.697981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] PATH_INFO: `/v3/projects/a892464c75204f11a509bb84c08867d1/users/24fba4bf977948fcb65b0052345f99e0/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.723257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a892464c75204f11a509bb84c08867d1, user_id=24fba4bf977948fcb65b0052345f99e0, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:45.729969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:45.752134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1068/2123] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:45 2022] PUT /identity/v3/projects/a892464c75204f11a509bb84c08867d1/users/24fba4bf977948fcb65b0052345f99e0/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:45.763205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:45.763430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:45.763931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:45.809252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] MFA Rules not processed for user `24fba4bf977948fcb65b0052345f99e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:45.810877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.914147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1056/2124] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:45.926906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:45.928979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:45.980338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:46.009946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172ac43-0980-4feb-bce5-ec822070843d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:46.015966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213f2ee-8e51-442e-83b3-74d89e53d358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:46.016664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f2ee-8e51-442e-83b3-74d89e53d358 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:46.017013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f2ee-8e51-442e-83b3-74d89e53d358 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:46.017354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f2ee-8e51-442e-83b3-74d89e53d358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:46.031449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213f2ee-8e51-442e-83b3-74d89e53d358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:46.034157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213f2ee-8e51-442e-83b3-74d89e53d358 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:46.055303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1069/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:46.270563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:46.272406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:46.372562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897752f3-23fc-4513-b015-e4b00aa0aa47 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:46.377795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:46.378438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:46.379156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:46.379435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] PATH_INFO: `/v3/users/d1c9cbc0b5f34a1ea2c352226cac756d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:46.380828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c9cbc0b5f34a1ea2c352226cac756d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:46.383154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:46.435664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c9cbc0b5f34a1ea2c352226cac756d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:46.439510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:46.444301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c9cbc0b5f34a1ea2c352226cac756d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:46.453265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c9cbc0b5f34a1ea2c352226cac756d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:46.453995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c9cbc0b5f34a1ea2c352226cac756d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:46.467452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c9cbc0b5f34a1ea2c352226cac756d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:46.473725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1057/2126] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:46 2022] DELETE /identity/v3/users/d1c9cbc0b5f34a1ea2c352226cac756d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:46.478574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:46.479148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:46.479148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:46.498479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:46.499637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:46.559730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1070/2127] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:46.569825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:46.571531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:46.639334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c654b-efa9-4a72-87d3-c7c01483d300 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:46.645388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:46.646352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:46.646632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:46.646930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:46.656587 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:46.657972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:46.669152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1058/2128] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:46.942383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:46.944143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:46.960108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ba39b-745d-454c-8280-598e2246bc50 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:46.974495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:46.975821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:46.976081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:46.976352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] PATH_INFO: `/v3/projects/2334aea2197446088bc9cabc439ea243` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:46.977657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2334aea2197446088bc9cabc439ea243)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:46.979967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:47.060915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2334aea2197446088bc9cabc439ea243', 'request_id': 'req-000215f4-f018-496e-b10d-dba1de493d65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.068161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2334aea2197446088bc9cabc439ea243', 'request_id': 'req-000215f4-f018-496e-b10d-dba1de493d65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.075222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2334aea2197446088bc9cabc439ea243', 'request_id': 'req-000215f4-f018-496e-b10d-dba1de493d65'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.096754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] The token cache is being invalidate because project 2334aea2197446088bc9cabc439ea243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:47.097105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.097810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-000215f4-f018-496e-b10d-dba1de493d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.099989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1071/2129] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:46 2022] DELETE /identity/v3/projects/2334aea2197446088bc9cabc439ea243 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:47.103880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:47.115713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3809cc6b-4c00-401d-92b7-98643784715a service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:47.169126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:47.169456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:47.169681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:47.186532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:47.187225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:47.187499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:47.187798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] PATH_INFO: `/v3/users/44ccff4cc1a6475b83f98ad34fcef83f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:47.189155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ccff4cc1a6475b83f98ad34fcef83f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:47.191167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:47.191364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] MFA Rules not processed for user `75172e2c3a9a425fa5a1070a0926fdb3`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:47.192601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:47.251836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ccff4cc1a6475b83f98ad34fcef83f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.261417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ccff4cc1a6475b83f98ad34fcef83f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.268553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1072/2130] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:47.276829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ccff4cc1a6475b83f98ad34fcef83f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.277925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ccff4cc1a6475b83f98ad34fcef83f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.287770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:47.298256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-69dec4e8-9a07-4576-838f-22d76bf9684a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ccff4cc1a6475b83f98ad34fcef83f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:47.307249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1059/2131] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:47 2022] DELETE /identity/v3/users/44ccff4cc1a6475b83f98ad34fcef83f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:47.908823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:47.910401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:47.928840 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e6e2e-b39c-4505-abd5-77340a7fcfa2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:47.933442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:48.006429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.008134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.008624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.009160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] PATH_INFO: `/v3/projects/c50e4ba014f14fd2a81fe8777fa348ba` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.011989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c50e4ba014f14fd2a81fe8777fa348ba)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.015336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.087595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c50e4ba014f14fd2a81fe8777fa348ba', 'request_id': 'req-e28847a3-265c-47a8-9dbd-86e8152bd3e4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.095044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c50e4ba014f14fd2a81fe8777fa348ba', 'request_id': 'req-e28847a3-265c-47a8-9dbd-86e8152bd3e4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.102214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c50e4ba014f14fd2a81fe8777fa348ba', 'request_id': 'req-e28847a3-265c-47a8-9dbd-86e8152bd3e4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.121879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] The token cache is being invalidate because project c50e4ba014f14fd2a81fe8777fa348ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:48.122259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.123047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e28847a3-265c-47a8-9dbd-86e8152bd3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.129586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1073/2132] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:47 2022] DELETE /identity/v3/projects/c50e4ba014f14fd2a81fe8777fa348ba => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:48.135597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.136092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.136292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.171859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:48.173371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:48.280768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1060/2133] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:48.292336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.292734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.292987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.316479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:48.317709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:48.327910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1074/2134] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:48.333282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.350009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd387ba0-076c-4f44-a368-7901f15b3680 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.359458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.360240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.360612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.360978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.361744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:48.362157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.363890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.382718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1061/2135] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:48.384854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.399342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948cc39-34ae-41bc-807b-6b92f3612a36 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.406796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.407441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.407684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.407961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.408711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.410875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.453815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1075/2136] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:48.458748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.471802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9712-3ee9-47f0-b7ee-a4223135d456 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.540483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.541192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.541524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.541885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.542568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.544607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.570167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1062/2137] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:48.571773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.583004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaf444-41b1-4611-b3c8-512576ca9ab3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.587714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.588325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.588608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.588874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.589644 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.595003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.614712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1076/2138] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:48.619383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.630208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc3fff-3343-48d7-b057-77f10ef0e725 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.635196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.635874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.636156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.636459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.637119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.638794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.651255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1063/2139] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:48.655747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.670093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd75f-77d4-44f2-b44b-1189a7b39a5e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.675272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a002c-3317-4664-bcb4-7404735e7d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.675943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a002c-3317-4664-bcb4-7404735e7d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.676637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a002c-3317-4664-bcb4-7404735e7d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.676637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a002c-3317-4664-bcb4-7404735e7d64 admin admin] PATH_INFO: `/v3/projects/75998e90ce8649859744b593d816ff0a/users/a5f73788d0e8403b927b75fb5137b328/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.686332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.688773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:48.694465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a002c-3317-4664-bcb4-7404735e7d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75998e90ce8649859744b593d816ff0a, user_id=a5f73788d0e8403b927b75fb5137b328, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.697405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a002c-3317-4664-bcb4-7404735e7d64 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.702333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff812795-45e6-4b72-930c-3f7600cfbf09 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.715392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1077/2140] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:48 2022] PUT /identity/v3/projects/75998e90ce8649859744b593d816ff0a/users/a5f73788d0e8403b927b75fb5137b328/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:48.725237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:48.725907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.726182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.726419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.726560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] PATH_INFO: `/v3/users/24fba4bf977948fcb65b0052345f99e0` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.726762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.727038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.727660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fba4bf977948fcb65b0052345f99e0)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:48.729946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:48.771752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] MFA Rules not processed for user `a5f73788d0e8403b927b75fb5137b328`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:48.773237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:48.802153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:48.802360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fba4bf977948fcb65b0052345f99e0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.807751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:48.814496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fba4bf977948fcb65b0052345f99e0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.830478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fba4bf977948fcb65b0052345f99e0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.831500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fba4bf977948fcb65b0052345f99e0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.848708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e6def40-9999-4eb8-9e88-5ad88ade342d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fba4bf977948fcb65b0052345f99e0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:48.855836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1064/2141] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:48 2022] DELETE /identity/v3/users/24fba4bf977948fcb65b0052345f99e0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:48.860585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:48.861621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:48.861964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:48.877854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1078/2142] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:48.883004 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.885105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:48.890913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:48.892513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:48.951747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a77cd-ff38-445c-ad2e-5f9d52ac0d70 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:48.966083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1065/2143] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:48.973879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:48.975378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:49.032589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.033541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.034559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.035001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.035784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.037915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.054662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8adce-2921-4d5f-b724-ad3366a7a0e3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.065662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.066371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.067327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.067327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.079502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.080664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1079/2144] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:48 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:49.081259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.085038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.099764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1066/2145] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:49.156440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:49.171865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858ae23-1b37-4180-976f-df0f32a3413e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.185286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.186485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.187124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.187966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.188627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.190658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.215498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1080/2146] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:49 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:49.219155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.229896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcb774-9f48-47d0-8414-59f9443b1048 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.234620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.235255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.235529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.235819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.236491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.238098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.252541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1067/2147] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:49.255146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.266740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ca4f0-8c90-42dc-becd-fe186fe84f58 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.272006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.272677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.273023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.273220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] PATH_INFO: `/v3/projects/7e10b6c103404a0bbd192ebaf6c7a8f7/users/d9fe2d956bdd42ecadfcbd294b75184e/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.289824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e10b6c103404a0bbd192ebaf6c7a8f7, user_id=d9fe2d956bdd42ecadfcbd294b75184e, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.292830 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.307549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1081/2148] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:49 2022] PUT /identity/v3/projects/7e10b6c103404a0bbd192ebaf6c7a8f7/users/d9fe2d956bdd42ecadfcbd294b75184e/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:49.312117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.322511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc16e44-a0e6-45db-bd3a-c9f277fb2893 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.389104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da596aca-385a-43d4-9e30-d59f67d336d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.389743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596aca-385a-43d4-9e30-d59f67d336d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.390405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596aca-385a-43d4-9e30-d59f67d336d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.390405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596aca-385a-43d4-9e30-d59f67d336d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.390983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da596aca-385a-43d4-9e30-d59f67d336d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.392639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da596aca-385a-43d4-9e30-d59f67d336d1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.396259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:49.406504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1068/2149] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:49.410709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.423489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8887e-ced3-47f1-a26d-6aacc3ddac99 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.429989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.430777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.431131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.431500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] PATH_INFO: `/v3/projects/7e10b6c103404a0bbd192ebaf6c7a8f7/users/d9fe2d956bdd42ecadfcbd294b75184e/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.433557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e10b6c103404a0bbd192ebaf6c7a8f7, user_id=d9fe2d956bdd42ecadfcbd294b75184e, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.436334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.454030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1082/2150] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:49 2022] PUT /identity/v3/projects/7e10b6c103404a0bbd192ebaf6c7a8f7/users/d9fe2d956bdd42ecadfcbd294b75184e/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:49.465578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.465909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.466130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.502879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] MFA Rules not processed for user `d9fe2d956bdd42ecadfcbd294b75184e`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:49.505637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:49.535578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.537766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:49.647059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1069/2151] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:49.661632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:49.663247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:49.667276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be52f8d-344b-480d-b377-97138ecd8600 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.676060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.676841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.677121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.677392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] PATH_INFO: `/v3/projects/a892464c75204f11a509bb84c08867d1` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.678796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a892464c75204f11a509bb84c08867d1)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.681769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.774923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c82b9-8de6-41f9-953d-ea6693a49d07 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:49.802846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a892464c75204f11a509bb84c08867d1', 'request_id': 'req-852a703e-219a-4573-85a9-ae00d10aa83b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:49.802846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a892464c75204f11a509bb84c08867d1', 'request_id': 'req-852a703e-219a-4573-85a9-ae00d10aa83b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:49.808076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a892464c75204f11a509bb84c08867d1', 'request_id': 'req-852a703e-219a-4573-85a9-ae00d10aa83b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:49.826307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] The token cache is being invalidate because project a892464c75204f11a509bb84c08867d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:49.826789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:49.827564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:49.838179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1083/2152] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:49 2022] DELETE /identity/v3/projects/a892464c75204f11a509bb84c08867d1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:49.852230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:49.853025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:49.853401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:49.853769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:49.856150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:49.926923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:49.943962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:49.947456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f686fa-6786-4502-8618-58fac9b4461c service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:49.983995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1070/2153] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:48:50.143651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:50.145509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:50.198563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:50.231677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a703e-219a-4573-85a9-ae00d10aa83b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:50.238177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:50.239190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:50.239649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:50.240159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] PATH_INFO: `/v3/users/a5f73788d0e8403b927b75fb5137b328` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:50.241525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f73788d0e8403b927b75fb5137b328)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:50.243657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:50.311349 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f73788d0e8403b927b75fb5137b328'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.327639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f73788d0e8403b927b75fb5137b328'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.347741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f73788d0e8403b927b75fb5137b328'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.348670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f73788d0e8403b927b75fb5137b328'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.363196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f73788d0e8403b927b75fb5137b328'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.371645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1084/2154] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:50 2022] DELETE /identity/v3/users/a5f73788d0e8403b927b75fb5137b328 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:50.377139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:50.377644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:50.377756 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:50.400726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:50.401942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:50.467936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1071/2155] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:50.478184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:50.480672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:50.545014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509b4b4-2045-4e41-b601-238eed29cd22 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:50.549263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:50.549881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:50.550186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:50.550508 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:50.562030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:50.563721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:50.573811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1085/2156] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:50.862805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:50.864620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:50.894317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2694e-afa1-463f-9ee7-0bcdd8ae46e2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:50.899767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:50.900543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:50.900838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:50.901229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] PATH_INFO: `/v3/projects/75998e90ce8649859744b593d816ff0a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:50.902613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75998e90ce8649859744b593d816ff0a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:50.904676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:50.968183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75998e90ce8649859744b593d816ff0a', 'request_id': 'req-3e3d68c7-b723-41d2-94df-32414b67972f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.972426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75998e90ce8649859744b593d816ff0a', 'request_id': 'req-3e3d68c7-b723-41d2-94df-32414b67972f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:50.978848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75998e90ce8649859744b593d816ff0a', 'request_id': 'req-3e3d68c7-b723-41d2-94df-32414b67972f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.002098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] The token cache is being invalidate because project 75998e90ce8649859744b593d816ff0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:51.002323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.002977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.005403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1072/2157] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:50 2022] DELETE /identity/v3/projects/75998e90ce8649859744b593d816ff0a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:51.009333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:51.020822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095db3a-a9dd-4202-82e8-65637c3d8ea4 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:51.077354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:51.077978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.078249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.078518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] PATH_INFO: `/v3/users/d9fe2d956bdd42ecadfcbd294b75184e` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.079706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fe2d956bdd42ecadfcbd294b75184e)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:51.081661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:51.083390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:51.133115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fe2d956bdd42ecadfcbd294b75184e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.140569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fe2d956bdd42ecadfcbd294b75184e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.148661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fe2d956bdd42ecadfcbd294b75184e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.149474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fe2d956bdd42ecadfcbd294b75184e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.162333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7bd07bb9-5ed9-40e6-bf38-6dd88b3458c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fe2d956bdd42ecadfcbd294b75184e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.168340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1086/2158] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:51 2022] DELETE /identity/v3/users/d9fe2d956bdd42ecadfcbd294b75184e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:51.502158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:51.503664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:51.516633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d68c7-b723-41d2-94df-32414b67972f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:51.581800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:51.582444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.582765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.583048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] PATH_INFO: `/v3/projects/7e10b6c103404a0bbd192ebaf6c7a8f7` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.584173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e10b6c103404a0bbd192ebaf6c7a8f7)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:51.586100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:51.602280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:51.646333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e10b6c103404a0bbd192ebaf6c7a8f7', 'request_id': 'req-23e2531d-a1e7-4266-b771-7efebf4512c1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.652870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e10b6c103404a0bbd192ebaf6c7a8f7', 'request_id': 'req-23e2531d-a1e7-4266-b771-7efebf4512c1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.659545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e10b6c103404a0bbd192ebaf6c7a8f7', 'request_id': 'req-23e2531d-a1e7-4266-b771-7efebf4512c1'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.676706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] The token cache is being invalidate because project 7e10b6c103404a0bbd192ebaf6c7a8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:51.676993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.677621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23e2531d-a1e7-4266-b771-7efebf4512c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:51.679199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1073/2159] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:51 2022] DELETE /identity/v3/projects/7e10b6c103404a0bbd192ebaf6c7a8f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:51.684591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.684980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.685420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.708382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:51.710427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:51.770637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1087/2160] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:51.778396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.778727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.779039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.799772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:51.801001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:51.813336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1074/2161] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:51.817901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:51.829047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3ff71-d8c4-4786-95ec-08192c29a05c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:51.834630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:51.835281 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.835554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.835815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.836462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:51.836759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:51.838359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:51.850629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1088/2162] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:51.855195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:51.864552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ceb45-5981-4746-b982-b39ef22a13a6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:51.869721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:51.870327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.870598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.870927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.871543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:51.873454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:51.908039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1075/2163] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:51 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:51.909500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:51.919909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c78bb-153d-4b0d-88b7-b3c70ff5c126 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:51.980006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:51.980694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:51.980971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:51.981238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:51.981955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:51.983883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:51.996932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:52.013206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.013396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1089/2164] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:51 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:52.025178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57de3f-49b4-421c-b257-5d2014dc4f7c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.031067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.031340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.031768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.032135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.032871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.034641 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.060031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1076/2165] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:52.064603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.075786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2d63-9afc-4c2c-bd81-c31c1fd7c9f6 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.080999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aafaf-e298-4066-bdf9-8c8321acad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.081690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aafaf-e298-4066-bdf9-8c8321acad20 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.082035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aafaf-e298-4066-bdf9-8c8321acad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.082370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aafaf-e298-4066-bdf9-8c8321acad20 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.084175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aafaf-e298-4066-bdf9-8c8321acad20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.085971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aafaf-e298-4066-bdf9-8c8321acad20 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.098807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1090/2166] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:52.102810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.113964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead2360-5f84-4fae-8ebe-1f2debfe7f0c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.118991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.119671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.119952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.120253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] PATH_INFO: `/v3/projects/7187ac3d4eb143ac999019393076d84a/users/4e3c2c4af58b4233b94cd38f74ec806e/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.137018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7187ac3d4eb143ac999019393076d84a, user_id=4e3c2c4af58b4233b94cd38f74ec806e, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.140841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.158766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1077/2167] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:52 2022] PUT /identity/v3/projects/7187ac3d4eb143ac999019393076d84a/users/4e3c2c4af58b4233b94cd38f74ec806e/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:48:52.167959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.168436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.168624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.196598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] MFA Rules not processed for user `4e3c2c4af58b4233b94cd38f74ec806e`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:52.197948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:52.284021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1091/2168] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:52.288627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.358402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac9a6-c3b0-4493-800b-4ee6a2a24e7c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.363272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.363878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.364153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.364419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.365082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.367020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.399396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1078/2169] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:52 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:52.403609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.419817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058ded-648e-4b2b-8c7c-9d548da81d71 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.491159 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.491865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.492141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.492433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.493072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.495097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.517908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1092/2170] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:52 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:52.522281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.532976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcce1db-3d2f-477c-9766-59a5bcb9afab admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.538270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.538911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.539192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.539470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.540120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.541739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.557363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1079/2171] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:52.558557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.569509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf64868-4340-4552-989c-95f48acfe0e1 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.574963 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.575789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.576084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.576348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] PATH_INFO: `/v3/projects/f4f9f67a1e724fff9da6a9fed72aaa0b/users/0fe7771ddcb0424fbd03b3c0c0fc4d42/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.593699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f9f67a1e724fff9da6a9fed72aaa0b, user_id=0fe7771ddcb0424fbd03b3c0c0fc4d42, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.596853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.612093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1093/2172] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:52 2022] PUT /identity/v3/projects/f4f9f67a1e724fff9da6a9fed72aaa0b/users/0fe7771ddcb0424fbd03b3c0c0fc4d42/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:52.615849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.626333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81995f69-ac48-4dfc-8e63-9438c27044c9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.635507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:52.687002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d2e91-e49f-434b-aad6-29e2b649d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.687718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2e91-e49f-434b-aad6-29e2b649d04e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.688000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2e91-e49f-434b-aad6-29e2b649d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.688409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d2e91-e49f-434b-aad6-29e2b649d04e admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.689166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d2e91-e49f-434b-aad6-29e2b649d04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.691166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d2e91-e49f-434b-aad6-29e2b649d04e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.705238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1080/2173] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:52.706951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.718434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec1f4f-7d33-4c5d-be61-988a9ec1a2c1 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.723703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.724447 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.724731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.725007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] PATH_INFO: `/v3/projects/f4f9f67a1e724fff9da6a9fed72aaa0b/users/0fe7771ddcb0424fbd03b3c0c0fc4d42/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.727019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f9f67a1e724fff9da6a9fed72aaa0b, user_id=0fe7771ddcb0424fbd03b3c0c0fc4d42, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.729759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.741012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1094/2174] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:52 2022] PUT /identity/v3/projects/f4f9f67a1e724fff9da6a9fed72aaa0b/users/0fe7771ddcb0424fbd03b3c0c0fc4d42/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:52.752392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.752758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.753103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.783260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] MFA Rules not processed for user `0fe7771ddcb0424fbd03b3c0c0fc4d42`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:52.784495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:52.856929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1081/2175] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:52.867938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:52.869713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:52.903951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:52.932001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c15a66-557c-42ad-9da2-1d7faab4d5bf admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:52.935962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0c449-a682-439e-a9bf-0c9693881525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:52.936562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0c449-a682-439e-a9bf-0c9693881525 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:52.936839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0c449-a682-439e-a9bf-0c9693881525 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:52.937109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0c449-a682-439e-a9bf-0c9693881525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:52.946354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0c449-a682-439e-a9bf-0c9693881525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:52.947848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0c449-a682-439e-a9bf-0c9693881525 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:52.957229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1095/2176] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:53.374982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:53.428883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b64c-4f81-4fbf-8630-b665fdb4f7a4 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:53.433379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:53.434002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:53.434278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:53.434550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] PATH_INFO: `/v3/users/4e3c2c4af58b4233b94cd38f74ec806e` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:53.435696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3c2c4af58b4233b94cd38f74ec806e)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:53.437656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:53.478371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:53.492579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3c2c4af58b4233b94cd38f74ec806e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:53.502957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3c2c4af58b4233b94cd38f74ec806e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:53.512543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3c2c4af58b4233b94cd38f74ec806e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:53.513310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3c2c4af58b4233b94cd38f74ec806e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:53.527705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3c2c4af58b4233b94cd38f74ec806e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:53.534880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1082/2177] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:53 2022] DELETE /identity/v3/users/4e3c2c4af58b4233b94cd38f74ec806e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:53.539545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:53.540017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:53.540136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:53.561751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:53.562911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:53.627021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1096/2178] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:53.640120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:53.641659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:53.700780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d36c7e-1ea5-47b3-9d2b-aa78678d3a52 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:53.704650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:53.705281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:53.705556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:53.705828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:53.715295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:53.716728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:53.727166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1083/2179] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:54.091812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:54.093519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:54.106628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f21dd-1f65-4576-ae3c-3f0ad31860c8 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:54.114009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:54.114764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:54.115123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:54.115510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] PATH_INFO: `/v3/projects/7187ac3d4eb143ac999019393076d84a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:54.116876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7187ac3d4eb143ac999019393076d84a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:54.119731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:54.173143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7187ac3d4eb143ac999019393076d84a', 'request_id': 'req-c42b8dda-a675-4650-bdc2-e89ccd94e464'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.179699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7187ac3d4eb143ac999019393076d84a', 'request_id': 'req-c42b8dda-a675-4650-bdc2-e89ccd94e464'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.187143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7187ac3d4eb143ac999019393076d84a', 'request_id': 'req-c42b8dda-a675-4650-bdc2-e89ccd94e464'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.201259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] The token cache is being invalidate because project 7187ac3d4eb143ac999019393076d84a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:54.201655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.202379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.204057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1097/2180] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:54 2022] DELETE /identity/v3/projects/7187ac3d4eb143ac999019393076d84a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:54.208773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:54.220475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d11078-dc89-4a8b-8f45-f0a401e01364 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:54.285098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:54.285744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:54.286023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:54.286294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] PATH_INFO: `/v3/users/0fe7771ddcb0424fbd03b3c0c0fc4d42` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:54.287496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe7771ddcb0424fbd03b3c0c0fc4d42)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:54.289430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:54.343528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe7771ddcb0424fbd03b3c0c0fc4d42'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.352025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe7771ddcb0424fbd03b3c0c0fc4d42'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.357874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:54.361275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe7771ddcb0424fbd03b3c0c0fc4d42'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.362461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe7771ddcb0424fbd03b3c0c0fc4d42'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.380169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a086c796-7a77-49bd-a0b4-9a00c984c4d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe7771ddcb0424fbd03b3c0c0fc4d42'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.387451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1084/2181] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:48:54 2022] DELETE /identity/v3/users/0fe7771ddcb0424fbd03b3c0c0fc4d42 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:54.797681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:54.804445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:54.821677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8dda-a675-4650-bdc2-e89ccd94e464 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:54.871487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:54.881058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:54.881977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:54.882473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:54.882790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] PATH_INFO: `/v3/projects/f4f9f67a1e724fff9da6a9fed72aaa0b` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:54.883954 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f9f67a1e724fff9da6a9fed72aaa0b)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:54.885880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:54.939918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f9f67a1e724fff9da6a9fed72aaa0b', 'request_id': 'req-1762875d-5ebb-4067-8e70-b980b583670a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.945896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f9f67a1e724fff9da6a9fed72aaa0b', 'request_id': 'req-1762875d-5ebb-4067-8e70-b980b583670a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.952127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f9f67a1e724fff9da6a9fed72aaa0b', 'request_id': 'req-1762875d-5ebb-4067-8e70-b980b583670a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.970337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] The token cache is being invalidate because project f4f9f67a1e724fff9da6a9fed72aaa0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:48:54.970700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.971401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1762875d-5ebb-4067-8e70-b980b583670a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:48:54.972959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1098/2182] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:48:54 2022] DELETE /identity/v3/projects/f4f9f67a1e724fff9da6a9fed72aaa0b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:54.977897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:54.978335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:54.978468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:54.999038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:55.000210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:55.060427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1085/2183] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:55.068369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.068652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.068920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.088814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:55.091026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:55.099430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1099/2184] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:55.103787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.113727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1330-5249-43af-b6e5-b61e1319422a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.118510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.119167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.119448 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.119715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.120376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:48:55.120744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.122480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.134130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1086/2185] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:48:55.138878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.148732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6356d16-cccd-45a9-81e2-945d9a0dfbf2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.154560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.155214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.155490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.155754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.156413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.158372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.189190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1100/2186] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:55.193119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.203292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e496097-a4e1-4199-a0d5-07c8e775771d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.268898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.269505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.269775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.270036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.270653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.272699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.297229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1087/2187] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:55.301597 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.312464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0d9d6-27c3-46f8-a03c-0960135a1f7b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.317559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.318148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.318423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.318704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.319366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.321037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.330958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1101/2188] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:55.334870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.345125 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8c6d0-92dc-4a1d-84c6-e58ea72d109d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.350012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d941a0-8f77-4669-aeaa-a77c7e1a3897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.350639 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d941a0-8f77-4669-aeaa-a77c7e1a3897 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.350962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d941a0-8f77-4669-aeaa-a77c7e1a3897 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.351226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d941a0-8f77-4669-aeaa-a77c7e1a3897 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.351885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d941a0-8f77-4669-aeaa-a77c7e1a3897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.353481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d941a0-8f77-4669-aeaa-a77c7e1a3897 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.363447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1088/2189] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:55.367938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.378635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14153-2589-4089-aa87-a427dcf35a8f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.383745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.384389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.384665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.384929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] PATH_INFO: `/v3/projects/e9a90653dea844e6a8fa19696c1d91f8/users/a86a75cd422540479ebf8cdefeafd5a6/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.400756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a90653dea844e6a8fa19696c1d91f8, user_id=a86a75cd422540479ebf8cdefeafd5a6, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.403614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.423264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1102/2190] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:55 2022] PUT /identity/v3/projects/e9a90653dea844e6a8fa19696c1d91f8/users/a86a75cd422540479ebf8cdefeafd5a6/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:55.433718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.434003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.434271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.463777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] MFA Rules not processed for user `a86a75cd422540479ebf8cdefeafd5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:55.465106 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:55.497099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:55.535692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1089/2191] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:55.540535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.605420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71986f7-c747-46be-b21b-10997a65348e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.613431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.614051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.614325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.614594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.615292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.617207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.645989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1103/2192] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:55.650844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.661876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fb0bd-3770-4c7c-b237-c46d9d03a1d3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.721904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.722535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.722891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.723128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.723770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.725724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.748800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1090/2193] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:55.753058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.760000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:55.764711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4d481-5eae-47e1-a179-2552ba52e823 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.782782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.783904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.784185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.784441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.785115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.787309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.800888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1104/2194] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:55.804950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.815837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6804840-4dc0-4141-8e95-b51002559af2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.821327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07db51-2eed-402c-8515-32624f83e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.821969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07db51-2eed-402c-8515-32624f83e03b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.822319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07db51-2eed-402c-8515-32624f83e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.822651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07db51-2eed-402c-8515-32624f83e03b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.823586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07db51-2eed-402c-8515-32624f83e03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.827168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07db51-2eed-402c-8515-32624f83e03b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.842282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1091/2195] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:48:55.846562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:55.865097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ecb3-e555-4cad-8c9f-4f30a61c01cb admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:55.870057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:55.871210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.871488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.871761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] PATH_INFO: `/v3/projects/d942adf4a02b4d57b3861cdd703ec614/users/c69eb7edb58f4064b6ad75438613d99e/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.889451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d942adf4a02b4d57b3861cdd703ec614, user_id=c69eb7edb58f4064b6ad75438613d99e, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:55.892838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:55.913534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1105/2196] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:55 2022] PUT /identity/v3/projects/d942adf4a02b4d57b3861cdd703ec614/users/c69eb7edb58f4064b6ad75438613d99e/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:55.924997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:55.925585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:55.925969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:55.989876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] MFA Rules not processed for user `c69eb7edb58f4064b6ad75438613d99e`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:55.991974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:56.061064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1092/2197] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:48:56.065721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.125421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5f167-e963-469c-a557-39994cdea532 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.132016 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.132635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.132913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.133181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.133826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.135780 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.165445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1106/2198] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:48:56 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:48:56.169421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.181177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6b0d-3571-409c-81e8-ef1de5991cc0 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.222579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:56.242256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.242899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.243176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.243443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.244071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.246053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.271280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1093/2199] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:48:56 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:48:56.275405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.286792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed2117-752a-47fc-a801-68cbe35fc000 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.292748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.293378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.293647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.294566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.295273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.296885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.308742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1107/2200] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:56.312903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.324143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ccbd2c-20e9-4bcb-acb8-569eca1e5f77 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.328881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.329562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.329828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.330101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] PATH_INFO: `/v3/projects/34941bcbd0ed4cd7b0e1606a66e87289/users/e1cf7d8a439b4a938a18fac9519b3478/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.349030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34941bcbd0ed4cd7b0e1606a66e87289, user_id=e1cf7d8a439b4a938a18fac9519b3478, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.351749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.366424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1094/2201] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:56 2022] PUT /identity/v3/projects/34941bcbd0ed4cd7b0e1606a66e87289/users/e1cf7d8a439b4a938a18fac9519b3478/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:56.370277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.380514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a90109-aec4-4454-bd53-8efe093f667a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.439663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff81936-e27d-4dbc-b38e-69eaa658f038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.440188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81936-e27d-4dbc-b38e-69eaa658f038 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.440458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81936-e27d-4dbc-b38e-69eaa658f038 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.440725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff81936-e27d-4dbc-b38e-69eaa658f038 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.441370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff81936-e27d-4dbc-b38e-69eaa658f038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.443063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff81936-e27d-4dbc-b38e-69eaa658f038 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.452966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1108/2202] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:48:56.457560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.468341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe7fd7-03c4-4ce9-9dda-f36ee3504870 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.473259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.473913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.474190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.474460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] PATH_INFO: `/v3/projects/34941bcbd0ed4cd7b0e1606a66e87289/users/e1cf7d8a439b4a938a18fac9519b3478/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.476493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34941bcbd0ed4cd7b0e1606a66e87289, user_id=e1cf7d8a439b4a938a18fac9519b3478, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.479257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.489931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1095/2203] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:48:56 2022] PUT /identity/v3/projects/34941bcbd0ed4cd7b0e1606a66e87289/users/e1cf7d8a439b4a938a18fac9519b3478/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:48:56.500114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.500400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.500671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.530055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] MFA Rules not processed for user `e1cf7d8a439b4a938a18fac9519b3478`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:48:56.531317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:56.565323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:56.609274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1109/2204] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:48:56.621630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:56.623521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:56.683144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd04441-983c-46d1-aa31-d82cc0a9ab09 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:56.689038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:56.689952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:56.690209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:56.690532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:56.751120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:56.752565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:56.761583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1096/2205] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:58.318165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:58.319732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:48:58.332722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020d93-cbd3-4d41-b641-d0decda79202 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:58.339358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:58.340063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:58.340337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:58.340604 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:58.414856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:58.416307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:58.426236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1110/2206] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:48:59.011685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:48:59.021793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e1cfa-c73b-4d8e-ae8a-56253b6d4ef5 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:48:59.026443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f236a-fec8-43da-8db8-ad74245a0856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:48:59.027279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f236a-fec8-43da-8db8-ad74245a0856 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:48:59.027558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f236a-fec8-43da-8db8-ad74245a0856 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:48:59.027853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f236a-fec8-43da-8db8-ad74245a0856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:48:59.040502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f236a-fec8-43da-8db8-ad74245a0856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:48:59.042020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f236a-fec8-43da-8db8-ad74245a0856 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:48:59.052422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1097/2207] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:48:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:03.099112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:03.160924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccff81c-9ce1-4643-9698-bac6eef08012 service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:03.166619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:03.167249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:03.167521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:03.167800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] PATH_INFO: `/v3/users/a86a75cd422540479ebf8cdefeafd5a6` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:03.168906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86a75cd422540479ebf8cdefeafd5a6)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:03.170819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:03.226473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86a75cd422540479ebf8cdefeafd5a6'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.233516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86a75cd422540479ebf8cdefeafd5a6'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.242319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86a75cd422540479ebf8cdefeafd5a6'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.242983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86a75cd422540479ebf8cdefeafd5a6'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.244877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:03.257085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86a75cd422540479ebf8cdefeafd5a6'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.263333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1111/2208] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:03 2022] DELETE /identity/v3/users/a86a75cd422540479ebf8cdefeafd5a6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:03.267979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:03.268748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:03.268836 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:03.293375 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:03.295199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:03.337826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:03.369961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1098/2209] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:03.380428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:03.382209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:03.442769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa6c87-17b1-42a9-90ea-e3af7f35a093 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:03.446530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:03.447633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:03.447633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:03.447836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:03.457517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:03.459053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:03.469522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1112/2210] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:03.851525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:03.853079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:03.865444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b321a9-fb7a-4223-8992-f8d7c2cdc2b2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:03.870383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:03.871076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:03.871356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:03.871685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] PATH_INFO: `/v3/projects/e9a90653dea844e6a8fa19696c1d91f8` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:03.872811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a90653dea844e6a8fa19696c1d91f8)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:03.874863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:03.923801 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a90653dea844e6a8fa19696c1d91f8', 'request_id': 'req-80b6c763-ed41-4b64-8154-f200f3947740'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.929468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a90653dea844e6a8fa19696c1d91f8', 'request_id': 'req-80b6c763-ed41-4b64-8154-f200f3947740'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.935672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a90653dea844e6a8fa19696c1d91f8', 'request_id': 'req-80b6c763-ed41-4b64-8154-f200f3947740'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.949705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] The token cache is being invalidate because project e9a90653dea844e6a8fa19696c1d91f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:03.949973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.950577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:03.952075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1099/2211] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:03 2022] DELETE /identity/v3/projects/e9a90653dea844e6a8fa19696c1d91f8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:03.956266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:03.967990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14d05-c1c0-4af9-b359-647e5985e06d service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:04.033035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:04.033658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:04.033934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:04.034197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] PATH_INFO: `/v3/users/c69eb7edb58f4064b6ad75438613d99e` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:04.035330 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69eb7edb58f4064b6ad75438613d99e)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:04.037260 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:04.087826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69eb7edb58f4064b6ad75438613d99e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.094476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69eb7edb58f4064b6ad75438613d99e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.103250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69eb7edb58f4064b6ad75438613d99e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.103893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69eb7edb58f4064b6ad75438613d99e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.120039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69eb7edb58f4064b6ad75438613d99e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.126072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1113/2212] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:03 2022] DELETE /identity/v3/users/c69eb7edb58f4064b6ad75438613d99e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:04.547428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:04.549051 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:04.580179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c763-ed41-4b64-8154-f200f3947740 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:04.651859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:04.652349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:04.652695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:04.653035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] PATH_INFO: `/v3/projects/d942adf4a02b4d57b3861cdd703ec614` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:04.655275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d942adf4a02b4d57b3861cdd703ec614)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:04.657102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:04.720038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd942adf4a02b4d57b3861cdd703ec614', 'request_id': 'req-c38d7cc6-8e36-4f19-97eb-acff399a8b57'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.727906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd942adf4a02b4d57b3861cdd703ec614', 'request_id': 'req-c38d7cc6-8e36-4f19-97eb-acff399a8b57'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.729199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:04.736321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd942adf4a02b4d57b3861cdd703ec614', 'request_id': 'req-c38d7cc6-8e36-4f19-97eb-acff399a8b57'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.752696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] The token cache is being invalidate because project d942adf4a02b4d57b3861cdd703ec614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:04.752977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.753600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.755344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1100/2213] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:04 2022] DELETE /identity/v3/projects/d942adf4a02b4d57b3861cdd703ec614 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:04.759279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:04.761793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:04.773772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:04.778764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc5a3-9daf-48dc-aba8-263ab98108a4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:04.875891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:04.876699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:04.876982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:04.877257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] PATH_INFO: `/v3/users/e1cf7d8a439b4a938a18fac9519b3478` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:04.878423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cf7d8a439b4a938a18fac9519b3478)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:04.880607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:04.948988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cf7d8a439b4a938a18fac9519b3478'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.956242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cf7d8a439b4a938a18fac9519b3478'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.969212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cf7d8a439b4a938a18fac9519b3478'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.970551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cf7d8a439b4a938a18fac9519b3478'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.992300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbb5e391-f720-4cf2-baf9-6226e01db4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cf7d8a439b4a938a18fac9519b3478'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:04.999613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1114/2214] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:04 2022] DELETE /identity/v3/users/e1cf7d8a439b4a938a18fac9519b3478 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:05.381644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.383503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:05.409221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7cc6-8e36-4f19-97eb-acff399a8b57 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.469575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.470233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.470509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.470847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] PATH_INFO: `/v3/projects/34941bcbd0ed4cd7b0e1606a66e87289` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.472007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=34941bcbd0ed4cd7b0e1606a66e87289)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:05.473936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:05.523179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34941bcbd0ed4cd7b0e1606a66e87289', 'request_id': 'req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:05.528815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34941bcbd0ed4cd7b0e1606a66e87289', 'request_id': 'req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:05.534810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34941bcbd0ed4cd7b0e1606a66e87289', 'request_id': 'req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:05.548434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] The token cache is being invalidate because project 34941bcbd0ed4cd7b0e1606a66e87289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:05.549014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:05.549326 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0ec1f54-febc-49f3-afb0-0edcabbbbfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:05.550826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1101/2215] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:05 2022] DELETE /identity/v3/projects/34941bcbd0ed4cd7b0e1606a66e87289 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:05.555809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.556248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.556357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.576312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:05.577468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:05.640665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1115/2216] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:49:05.650077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.650358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.650623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.671144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:05.672352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:05.681766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1102/2217] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:05.686995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.696796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8ed70-7fea-471b-8ec3-267a1640f42a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.701568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.702202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.702497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.702786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.703432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:49:05.703729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:05.705336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:05.721423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1116/2218] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:49:05.728231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.742493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db31cc-fdc4-4414-a467-a52fe43ac76d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.749119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.749883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.750157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.750432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.751093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:05.753004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:05.787501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1103/2219] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:49:05 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:49:05.793156 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.803734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4640bf-c788-4207-a7f0-d377cff03617 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.813557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:05.865207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.865743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.866017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.866287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.866946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:05.868887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:05.892666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1117/2220] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:49:05 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:49:05.899244 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.912130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c40ed-656a-4701-8d8f-c4be692362e4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.916892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.917543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.917822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.918088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.918792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:05.920383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:05.930512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1104/2221] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:49:05.934722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.945234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6686f1-aeea-4a86-b050-802057f3f0b9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.950347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafea700-ef5d-4d2d-b311-ccd3c6cb38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.950965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea700-ef5d-4d2d-b311-ccd3c6cb38ef admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.951239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea700-ef5d-4d2d-b311-ccd3c6cb38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.951505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea700-ef5d-4d2d-b311-ccd3c6cb38ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.952152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea700-ef5d-4d2d-b311-ccd3c6cb38ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:05.953772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea700-ef5d-4d2d-b311-ccd3c6cb38ef admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:05.964290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1118/2222] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:49:05.968496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:05.978568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dede395-c689-450d-9ecc-8c1be0846980 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:05.983277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:05.984017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:05.984294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:05.984577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] PATH_INFO: `/v3/projects/4c1a583e26ce4ff7a547a54598f759b1/users/4c4a8ee9b68340a6a6dc12ecc4199680/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:05.999938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1a583e26ce4ff7a547a54598f759b1, user_id=4c4a8ee9b68340a6a6dc12ecc4199680, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:06.004971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:06.022499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1105/2223] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:49:05 2022] PUT /identity/v3/projects/4c1a583e26ce4ff7a547a54598f759b1/users/4c4a8ee9b68340a6a6dc12ecc4199680/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:06.035626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b040-763c-43eb-9f1f-4bfbcfef437b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:06.035910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b040-763c-43eb-9f1f-4bfbcfef437b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:06.036206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b040-763c-43eb-9f1f-4bfbcfef437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:06.069429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3844b040-763c-43eb-9f1f-4bfbcfef437b None None] MFA Rules not processed for user `4c4a8ee9b68340a6a6dc12ecc4199680`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:06.070712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3844b040-763c-43eb-9f1f-4bfbcfef437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:06.145621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1119/2224] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:06.159480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:06.162496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:06.180373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:06.225899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65876c-7c8b-47eb-9852-1b80ca8c3397 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:06.229545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:06.230157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:06.230433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:06.230735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:06.239240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:06.240700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:06.249671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1106/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:09.995925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edd64d-0158-4a06-9f5a-398636d5b635 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:09.996534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edd64d-0158-4a06-9f5a-398636d5b635 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:09.996534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edd64d-0158-4a06-9f5a-398636d5b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:10.017279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a6edd64d-0158-4a06-9f5a-398636d5b635 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:10.018919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a6edd64d-0158-4a06-9f5a-398636d5b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:10.084907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1120/2226] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:49:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:10.128387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:10.129811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:10.200225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc495915-c5a0-4e96-87a2-2409776ac1f9 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:10.205871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:10.206467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:10.206838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:10.207105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:10.215435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:10.217005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:10.225043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1107/2227] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:49:10.548812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b15ae-7f2c-4e84-85c7-da39eb167792 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:10.549101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b15ae-7f2c-4e84-85c7-da39eb167792 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:10.549375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b15ae-7f2c-4e84-85c7-da39eb167792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:10.571197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1d6b15ae-7f2c-4e84-85c7-da39eb167792 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:10.572427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1d6b15ae-7f2c-4e84-85c7-da39eb167792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:10.580909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1121/2228] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:49:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:10.594898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:10.605900 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2c965-bd83-4366-875a-61435294f002 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:10.620203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:10.620909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:10.621167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:10.621462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:10.632666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:10.634249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:10.642827 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1108/2229] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:49:10.810327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5d2f-9a01-48ca-b3ed-73c2becee9f5 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:10.810641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5d2f-9a01-48ca-b3ed-73c2becee9f5 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:10.810983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b5d2f-9a01-48ca-b3ed-73c2becee9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:10.832712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-978b5d2f-9a01-48ca-b3ed-73c2becee9f5 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:10.833854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-978b5d2f-9a01-48ca-b3ed-73c2becee9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:10.841748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1122/2230] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 10:49:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:10.857038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:10.868037 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e08ec-6f54-4025-9014-b10854f17086 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:10.873190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:10.873800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:10.874073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:10.874386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:10.883786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:10.885351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:10.893306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1109/2231] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:49:11.218576 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ffd86-5862-4a74-b0bf-9f18c44a2ce7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:11.219113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ffd86-5862-4a74-b0bf-9f18c44a2ce7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:11.219476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ffd86-5862-4a74-b0bf-9f18c44a2ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:11.245943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c61ffd86-5862-4a74-b0bf-9f18c44a2ce7 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:11.247944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c61ffd86-5862-4a74-b0bf-9f18c44a2ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:11.258938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1123/2232] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:49:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:11.273138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:11.285937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd1e71-5e72-4d49-a08d-c52bcafc16ba service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:11.300521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:11.301493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:11.302942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:11.303144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:11.317300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:11.320102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:11.331842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1110/2233] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 10:49:11.916558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:11.917224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:11.917767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:11.938165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:11.957579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:11.959765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:11.972765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1124/2234] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 10:49:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:11.994572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:12.011013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff6511-b363-43bc-aefb-248480eafc80 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:12.026177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666cfe-68e0-468f-98ac-b4ea6a45b7d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:12.026938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666cfe-68e0-468f-98ac-b4ea6a45b7d4 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:12.027319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666cfe-68e0-468f-98ac-b4ea6a45b7d4 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:12.027693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666cfe-68e0-468f-98ac-b4ea6a45b7d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:12.049363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666cfe-68e0-468f-98ac-b4ea6a45b7d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:12.052997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666cfe-68e0-468f-98ac-b4ea6a45b7d4 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:12.072714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1111/2235] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 10:49:14.409216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:14.410863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:14.485092 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d141d0-2c48-4b3a-b717-9481f2860c88 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:14.489885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:14.490551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:14.491042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:14.491318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] PATH_INFO: `/v3/users/75172e2c3a9a425fa5a1070a0926fdb3` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:14.492484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75172e2c3a9a425fa5a1070a0926fdb3)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:14.494728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:14.560394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75172e2c3a9a425fa5a1070a0926fdb3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:14.572162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75172e2c3a9a425fa5a1070a0926fdb3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:14.587860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75172e2c3a9a425fa5a1070a0926fdb3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:14.588764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75172e2c3a9a425fa5a1070a0926fdb3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:14.694442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75172e2c3a9a425fa5a1070a0926fdb3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:14.732501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1125/2236] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:14 2022] DELETE /identity/v3/users/75172e2c3a9a425fa5a1070a0926fdb3 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:14.737675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:14.738787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:14.738787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:14.793822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:14.796258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:14.894943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:14.932168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1112/2237] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:14.942103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:14.943660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:15.057149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c8d4-fd80-44f3-a9d0-9677f504de42 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:15.062311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078efd2-dec9-47e8-a228-ee1ba5e79d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:15.063432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078efd2-dec9-47e8-a228-ee1ba5e79d5d service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:15.063708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078efd2-dec9-47e8-a228-ee1ba5e79d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:15.063978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078efd2-dec9-47e8-a228-ee1ba5e79d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:15.087197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078efd2-dec9-47e8-a228-ee1ba5e79d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:15.088822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078efd2-dec9-47e8-a228-ee1ba5e79d5d service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:15.120545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1126/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:15.574271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:15.575896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:15.590480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396eed6-682b-4fa1-923f-56a9f272672d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:15.596832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:15.597513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:15.597847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:15.598056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] PATH_INFO: `/v3/projects/3609612b368c4c3e941e12ec04bf3744` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:15.599451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3609612b368c4c3e941e12ec04bf3744)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:15.601479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:15.662227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3609612b368c4c3e941e12ec04bf3744', 'request_id': 'req-32e7891a-83f3-474f-8291-c17bb67baac5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:15.668241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3609612b368c4c3e941e12ec04bf3744', 'request_id': 'req-32e7891a-83f3-474f-8291-c17bb67baac5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:15.675680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3609612b368c4c3e941e12ec04bf3744', 'request_id': 'req-32e7891a-83f3-474f-8291-c17bb67baac5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:15.695681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] The token cache is being invalidate because project 3609612b368c4c3e941e12ec04bf3744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:15.695885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:15.697194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-32e7891a-83f3-474f-8291-c17bb67baac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:15.699047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1113/2239] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:15 2022] DELETE /identity/v3/projects/3609612b368c4c3e941e12ec04bf3744 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:25.037272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350afc0-d915-409a-9786-fd42c8b83955 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:25.038287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350afc0-d915-409a-9786-fd42c8b83955 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:25.038740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350afc0-d915-409a-9786-fd42c8b83955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:25.074150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8350afc0-d915-409a-9786-fd42c8b83955 None None] MFA Rules not processed for user `f1921e11db8e45e4af638755cc163823`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:25.075551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8350afc0-d915-409a-9786-fd42c8b83955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:25.092091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:25.163129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1127/2240] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:25.690791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:33.865475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:33.866409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:33.866795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:33.890759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] MFA Rules not processed for user `61e3692e4d0e4892abab3d6387fa001f`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:33.892302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:33.959830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1114/2241] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:35.151188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=16 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:37.158929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c905f63-4fab-4dc1-8e17-21461cabf40b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:37.160008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c905f63-4fab-4dc1-8e17-21461cabf40b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:37.160328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c905f63-4fab-4dc1-8e17-21461cabf40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:37.180493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7c905f63-4fab-4dc1-8e17-21461cabf40b None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:37.182067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7c905f63-4fab-4dc1-8e17-21461cabf40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:37.241946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1128/2242] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:49:37.254761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:37.256187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:37.329341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd854d7-1853-4ed8-9097-a7dcf5faa7e1 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:37.334615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:37.335327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:37.335664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:37.336004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:37.345631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:37.347915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:37.358926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1115/2243] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:49:39.517802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:39.519887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:39.520420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:39.542399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:39.544133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:39.551721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1129/2244] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:39.566287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:39.577843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98144f-e574-490f-b05a-7958bbe23e62 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:39.584974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:39.585979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:39.586352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:39.586908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:39.598460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:39.600566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:39.618888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1116/2245] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:49:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:49:40.058598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:40.060783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:40.207179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f41b-05e1-49a6-8a5e-8517cd2935f4 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:40.222464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:40.223408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:40.223833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:40.224247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] PATH_INFO: `/v3/users/d74cbd6d82c84a1294af1af356d3d93a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:40.227451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74cbd6d82c84a1294af1af356d3d93a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:40.229622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:40.330837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74cbd6d82c84a1294af1af356d3d93a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:40.346246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74cbd6d82c84a1294af1af356d3d93a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:40.363686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74cbd6d82c84a1294af1af356d3d93a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:40.364921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74cbd6d82c84a1294af1af356d3d93a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:40.384551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74cbd6d82c84a1294af1af356d3d93a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:40.391824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1130/2246] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:40 2022] DELETE /identity/v3/users/d74cbd6d82c84a1294af1af356d3d93a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:41.532182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:41.554232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfcd3a6-cce4-45df-b4b0-513ac236c467 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:41.823204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:41.824195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:41.824659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:41.825128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] PATH_INFO: `/v3/projects/67a93af728d64eb589d8c8ac1e9fdf22` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:41.830308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67a93af728d64eb589d8c8ac1e9fdf22)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:41.832926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:41.885389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:41.974859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67a93af728d64eb589d8c8ac1e9fdf22', 'request_id': 'req-d5d03561-a38a-4796-9a1a-7216297de99e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:42.002400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67a93af728d64eb589d8c8ac1e9fdf22', 'request_id': 'req-d5d03561-a38a-4796-9a1a-7216297de99e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:42.013833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67a93af728d64eb589d8c8ac1e9fdf22', 'request_id': 'req-d5d03561-a38a-4796-9a1a-7216297de99e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:42.047841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] The token cache is being invalidate because project 67a93af728d64eb589d8c8ac1e9fdf22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:42.048536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:42.049443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d5d03561-a38a-4796-9a1a-7216297de99e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:42.053876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1117/2247] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:41 2022] DELETE /identity/v3/projects/67a93af728d64eb589d8c8ac1e9fdf22 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:47.101874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:47.103441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:47.120300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75d2e-849e-47df-9012-14a453f6866f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:47.136501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:47.214357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:47.215317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:47.215938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:47.216497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] PATH_INFO: `/v3/users/4c4a8ee9b68340a6a6dc12ecc4199680` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:47.220362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4a8ee9b68340a6a6dc12ecc4199680)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:47.222570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:47.324344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4a8ee9b68340a6a6dc12ecc4199680'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:47.338563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4a8ee9b68340a6a6dc12ecc4199680'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:47.357798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4a8ee9b68340a6a6dc12ecc4199680'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:47.358795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4a8ee9b68340a6a6dc12ecc4199680'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:47.377692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4a8ee9b68340a6a6dc12ecc4199680'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:47.391762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1131/2248] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:47 2022] DELETE /identity/v3/users/4c4a8ee9b68340a6a6dc12ecc4199680 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:47.396494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:47.397305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:47.397718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:47.433264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:47.434907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:47.562526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1118/2249] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:47.569262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:47.571518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:47.653125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6030-9ec4-444f-90b2-5231771be167 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:47.657547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f00c7a-353d-4e3c-957b-c7cb08674084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:47.658345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00c7a-353d-4e3c-957b-c7cb08674084 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:47.661071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00c7a-353d-4e3c-957b-c7cb08674084 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:47.661619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f00c7a-353d-4e3c-957b-c7cb08674084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:47.671992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00c7a-353d-4e3c-957b-c7cb08674084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:47.673679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f00c7a-353d-4e3c-957b-c7cb08674084 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:47.685336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1132/2250] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:48.031095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.033444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:48.048909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86f017-26d1-4859-90bc-4fd5b9e3a163 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.053755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.054762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.055135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.055470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] PATH_INFO: `/v3/projects/4c1a583e26ce4ff7a547a54598f759b1` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.056693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1a583e26ce4ff7a547a54598f759b1)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.058728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.125467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1a583e26ce4ff7a547a54598f759b1', 'request_id': 'req-23a5cb45-6490-4983-834c-75dfa90c14f5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:48.133922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1a583e26ce4ff7a547a54598f759b1', 'request_id': 'req-23a5cb45-6490-4983-834c-75dfa90c14f5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:48.140991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1a583e26ce4ff7a547a54598f759b1', 'request_id': 'req-23a5cb45-6490-4983-834c-75dfa90c14f5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:48.156934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] The token cache is being invalidate because project 4c1a583e26ce4ff7a547a54598f759b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:48.157477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:48.159231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-23a5cb45-6490-4983-834c-75dfa90c14f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:48.163486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1119/2251] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:48 2022] DELETE /identity/v3/projects/4c1a583e26ce4ff7a547a54598f759b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:48.168408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.168922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.169171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.189648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:48.190930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:48.231916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:48.263428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1133/2252] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:48.332912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.333212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.333603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.354935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:48.356059 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:48.366015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1120/2253] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:48.370408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.381064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f8df3-f831-4576-8d05-b0092b8698de None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.386305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.387040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.387377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.387711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.388505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:49:48.388885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.390787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.406306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1134/2254] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:49:48.410902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.421282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d42f-be9e-4521-97d0-27432607b599 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.426650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.427268 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.427546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.427822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.428465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.430407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.464574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1121/2255] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:49:48 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:49:48.466116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.476726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db6711-8cc6-4e4e-8965-cab2bd282258 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.544804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.545563 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.545900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.546237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.548615 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.550950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.580176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1135/2256] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:49:48 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:49:48.584593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.601034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344f273-a43d-4079-bc51-d187f226901d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.606428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.607137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.607487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.607830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.608768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.613509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.615465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:48.631948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.638080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1122/2257] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:49:48.646525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc90fa9-96a6-4a95-a692-30297586cda2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.651586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c160ef3-06cf-43f8-bba9-991895c6f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.652206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c160ef3-06cf-43f8-bba9-991895c6f6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.652483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c160ef3-06cf-43f8-bba9-991895c6f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.652753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c160ef3-06cf-43f8-bba9-991895c6f6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.653399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c160ef3-06cf-43f8-bba9-991895c6f6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.658636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c160ef3-06cf-43f8-bba9-991895c6f6e1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.671778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1136/2258] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:49:48.675729 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.695782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa110bc2-fd52-4af5-9c19-03f70813cc8c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:48.705577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:48.706306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.706796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.710579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] PATH_INFO: `/v3/projects/fbd5da41ef194a849c377c33ecdadebe/users/be38036edd8f4f189a64fda28ce0b5fa/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.731361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd5da41ef194a849c377c33ecdadebe, user_id=be38036edd8f4f189a64fda28ce0b5fa, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:48.734432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:48.761666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1123/2259] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:49:48 2022] PUT /identity/v3/projects/fbd5da41ef194a849c377c33ecdadebe/users/be38036edd8f4f189a64fda28ce0b5fa/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:49:48.769967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:48.771343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:48.771951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:48.823999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] MFA Rules not processed for user `be38036edd8f4f189a64fda28ce0b5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:48.825307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:48.920946 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1137/2260] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:48.936865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:48.939935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:49.068726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28a932-3f42-48bd-8e95-0fcfc5cd8a08 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:49.073645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03368b73-25eb-47c4-8a74-e7ed5f053e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:49.074496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368b73-25eb-47c4-8a74-e7ed5f053e6c service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:49.074820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368b73-25eb-47c4-8a74-e7ed5f053e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:49.075092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368b73-25eb-47c4-8a74-e7ed5f053e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:49.084963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368b73-25eb-47c4-8a74-e7ed5f053e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:49.086336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368b73-25eb-47c4-8a74-e7ed5f053e6c service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:49.114855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1124/2261] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:54.346793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:54.391685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:54.429111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059033e-56c3-44d6-85cc-6e8bf4a133ba None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:54.436849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:54.438204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:54.438976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:54.438976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] PATH_INFO: `/v3/users/be38036edd8f4f189a64fda28ce0b5fa` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:54.441694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be38036edd8f4f189a64fda28ce0b5fa)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:54.444875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:54.532276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be38036edd8f4f189a64fda28ce0b5fa'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:54.540401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be38036edd8f4f189a64fda28ce0b5fa'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:54.549949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be38036edd8f4f189a64fda28ce0b5fa'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:54.550986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be38036edd8f4f189a64fda28ce0b5fa'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:54.572717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be38036edd8f4f189a64fda28ce0b5fa'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:54.579197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1138/2262] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:49:54 2022] DELETE /identity/v3/users/be38036edd8f4f189a64fda28ce0b5fa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:54.583547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:54.584049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:54.584147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:54.608000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:54.609108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:54.685190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1125/2263] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:54.691645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:54.693476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:54.754962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e94a-f3d7-4740-94c0-14745948519a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:54.758970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e6421-15ba-4d40-b361-4073660d5016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:54.759581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e6421-15ba-4d40-b361-4073660d5016 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:54.759865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e6421-15ba-4d40-b361-4073660d5016 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:54.760177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e6421-15ba-4d40-b361-4073660d5016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:54.769915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e6421-15ba-4d40-b361-4073660d5016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:54.771463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e6421-15ba-4d40-b361-4073660d5016 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:54.781060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1139/2264] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:55.469166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:55.470693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:55.482842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9624b21-39b3-468f-897e-42f342599d45 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:55.488673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:55.489558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:55.489803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:55.490494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] PATH_INFO: `/v3/projects/fbd5da41ef194a849c377c33ecdadebe` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:55.491395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd5da41ef194a849c377c33ecdadebe)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:55.493352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:55.545640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd5da41ef194a849c377c33ecdadebe', 'request_id': 'req-473c9885-9c04-46b7-a2b5-30a27b09d62c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:55.551091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd5da41ef194a849c377c33ecdadebe', 'request_id': 'req-473c9885-9c04-46b7-a2b5-30a27b09d62c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:55.557970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd5da41ef194a849c377c33ecdadebe', 'request_id': 'req-473c9885-9c04-46b7-a2b5-30a27b09d62c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:55.567271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:55.572176 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] The token cache is being invalidate because project fbd5da41ef194a849c377c33ecdadebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:49:55.572470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:55.573567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-473c9885-9c04-46b7-a2b5-30a27b09d62c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:49:55.575445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1126/2265] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:49:55 2022] DELETE /identity/v3/projects/fbd5da41ef194a849c377c33ecdadebe => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:49:58.153050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70633-37f8-40f0-8b9e-3a7548b5233f None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.154116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70633-37f8-40f0-8b9e-3a7548b5233f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.154606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae70633-37f8-40f0-8b9e-3a7548b5233f None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.156823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1140/2266] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:49:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:49:58.164366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90e26b-66c4-44b4-862a-cd48fe887530 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.164904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90e26b-66c4-44b4-862a-cd48fe887530 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.164904 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90e26b-66c4-44b4-862a-cd48fe887530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.198404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2c90e26b-66c4-44b4-862a-cd48fe887530 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:58.200109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2c90e26b-66c4-44b4-862a-cd48fe887530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:58.277719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1127/2267] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:58.289985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70633-37f8-40f0-8b9e-3a7548b5233f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:58.292305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8ae70633-37f8-40f0-8b9e-3a7548b5233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:58.353114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae70633-37f8-40f0-8b9e-3a7548b5233f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:58.356777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f50ce-2eff-4c69-bb7f-5b2c4064a06f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:58.357386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f50ce-2eff-4c69-bb7f-5b2c4064a06f service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.357660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f50ce-2eff-4c69-bb7f-5b2c4064a06f service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.357928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f50ce-2eff-4c69-bb7f-5b2c4064a06f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.368154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f50ce-2eff-4c69-bb7f-5b2c4064a06f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:58.369588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f50ce-2eff-4c69-bb7f-5b2c4064a06f service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:58.375355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:49:58.380796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1141/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:58.454117 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e323a-2d4c-4be9-85c7-229fe9407ede None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.454447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e323a-2d4c-4be9-85c7-229fe9407ede None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.454745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e323a-2d4c-4be9-85c7-229fe9407ede None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.456092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1128/2269] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:49:58.461795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066adf5e-df11-47a3-94ec-1bee852ba436 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.462148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066adf5e-df11-47a3-94ec-1bee852ba436 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.462478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066adf5e-df11-47a3-94ec-1bee852ba436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.484363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-066adf5e-df11-47a3-94ec-1bee852ba436 None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:58.485595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-066adf5e-df11-47a3-94ec-1bee852ba436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:58.537123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1142/2270] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:58.550955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e323a-2d4c-4be9-85c7-229fe9407ede None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:58.552974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-014e323a-2d4c-4be9-85c7-229fe9407ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:58.568354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e323a-2d4c-4be9-85c7-229fe9407ede None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:58.572231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa58f9-e758-48e2-b43f-c117efae1c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:58.572816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa58f9-e758-48e2-b43f-c117efae1c6f service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.573092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa58f9-e758-48e2-b43f-c117efae1c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.573362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa58f9-e758-48e2-b43f-c117efae1c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.580562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa58f9-e758-48e2-b43f-c117efae1c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:58.581998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa58f9-e758-48e2-b43f-c117efae1c6f service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:58.589991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1129/2271] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:49:58.683569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c182c-b124-4117-ac5a-9b288bd0a2b9 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.683933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c182c-b124-4117-ac5a-9b288bd0a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.684264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c182c-b124-4117-ac5a-9b288bd0a2b9 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.685717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1143/2272] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:49:58.692075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07015fb2-7bb8-4f78-b19c-b79986aec30e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.692496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07015fb2-7bb8-4f78-b19c-b79986aec30e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.692882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07015fb2-7bb8-4f78-b19c-b79986aec30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.714018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-07015fb2-7bb8-4f78-b19c-b79986aec30e None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:49:58.715398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-07015fb2-7bb8-4f78-b19c-b79986aec30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:49:58.725413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1130/2273] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:49:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:49:58.736120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c182c-b124-4117-ac5a-9b288bd0a2b9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:49:58.747306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c182c-b124-4117-ac5a-9b288bd0a2b9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:49:58.751072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:49:58.751663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:49:58.751932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:49:58.752197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:49:58.762515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:49:58.763969 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:49:58.775187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1144/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:49:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:50:01.229140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b55de8-4d7f-491d-b286-1ed86c4d0ea1 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:50:01.229140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b55de8-4d7f-491d-b286-1ed86c4d0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:50:01.229680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b55de8-4d7f-491d-b286-1ed86c4d0ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:50:01.248103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-36b55de8-4d7f-491d-b286-1ed86c4d0ea1 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:50:01.249298 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-36b55de8-4d7f-491d-b286-1ed86c4d0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:50:01.304121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1131/2275] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:50:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:50:01.316364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:50:01.317864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:50:01.393477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67f86a-ad7f-49ce-959f-328caac39fa8 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:50:01.399924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:50:01.400499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:50:01.400795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:50:01.401057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:50:01.409814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:50:01.411428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:50:01.419499 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1145/2276] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:50:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:50:11.297038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=66 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.416397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=61 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:19.085931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:50:19.086398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:50:19.086501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:50:19.108798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:50:19.110011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:50:19.118025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1132/2277] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 10:50:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:50:19.141601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:50:19.154034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4c6b1-353d-477e-a99a-a90e03d17a3b service swift] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:50:19.161988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e15baf-df43-454c-bd8c-6695be14dc7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:50:19.162588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e15baf-df43-454c-bd8c-6695be14dc7b service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:50:19.162983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e15baf-df43-454c-bd8c-6695be14dc7b service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:50:19.163262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e15baf-df43-454c-bd8c-6695be14dc7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:50:19.171682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e15baf-df43-454c-bd8c-6695be14dc7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:50:19.173300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e15baf-df43-454c-bd8c-6695be14dc7b service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:50:19.181723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1146/2278] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:50:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:50:29.104061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:29.178504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=6 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:45.632704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:50:45.634163 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:50:45.727746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664574f-f91f-4dbb-924a-92ea8390f4d7 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:50:45.732850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:50:45.733475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:50:45.733750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:50:45.734021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:50:45.735980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:50:45.750006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:50:45.751618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12475d-4fee-4353-8c52-0bb44fa55915 service placement] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:50:45.762897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1133/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:50:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:50:54.445084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a614d-74e9-41d6-8421-fbf910b69e72 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:50:54.445659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a614d-74e9-41d6-8421-fbf910b69e72 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:50:54.446043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a614d-74e9-41d6-8421-fbf910b69e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:50:54.467341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-927a614d-74e9-41d6-8421-fbf910b69e72 None None] MFA Rules not processed for user `f1921e11db8e45e4af638755cc163823`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:50:54.468546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-927a614d-74e9-41d6-8421-fbf910b69e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:50:54.525472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1147/2280] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:50:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:50:55.758663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=32 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:04.518618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=25 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:05.109136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38986570-74af-4d71-8b57-104fde3af669 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:51:05.109627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38986570-74af-4d71-8b57-104fde3af669 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:51:05.109717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38986570-74af-4d71-8b57-104fde3af669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:51:05.131224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-38986570-74af-4d71-8b57-104fde3af669 None None] MFA Rules not processed for user `61e3692e4d0e4892abab3d6387fa001f`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:51:05.132456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-38986570-74af-4d71-8b57-104fde3af669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:51:05.192793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1134/2281] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:51:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:51:09.384472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1aaa6-1456-4c72-9509-7535a7711b0c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:51:09.384917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1aaa6-1456-4c72-9509-7535a7711b0c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:51:09.385285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1aaa6-1456-4c72-9509-7535a7711b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:51:09.408756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-71c1aaa6-1456-4c72-9509-7535a7711b0c None None] MFA Rules not processed for user `ee081ad8284348af88afe1a8c3dabc97`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:51:09.410125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-71c1aaa6-1456-4c72-9509-7535a7711b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:51:09.476486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1148/2282] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:51:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:51:15.185684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=25 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:19.461645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=25 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:44.254705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:51:44.255238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:51:44.255345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:51:44.275159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] MFA Rules not processed for user `afd753e2b6534bfc8f015ab1e9ed939d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:51:44.276359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:51:44.332868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1135/2283] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:51:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:51:54.325604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=25 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:09.203806 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:09.204382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:09.204382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:09.224412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] MFA Rules not processed for user `f1921e11db8e45e4af638755cc163823`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:09.225621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:09.232582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1149/2284] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:16.311247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:16.321195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed4df-b485-4607-a364-f63d46437e91 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:16.325333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:16.326071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:16.326350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:16.326619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:16.328439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:16.400628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:16.402078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:16.411680 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1136/2285] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:17.589901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:17.591438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:17.605430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e939b-6ea0-404b-8ce3-8005e2382a1f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:17.609890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:17.610512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:17.610853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:17.611120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] PATH_INFO: `/v3/users/61e3692e4d0e4892abab3d6387fa001f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:17.612249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e3692e4d0e4892abab3d6387fa001f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:17.614152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:17.661023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e3692e4d0e4892abab3d6387fa001f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:17.668390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e3692e4d0e4892abab3d6387fa001f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:17.677253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e3692e4d0e4892abab3d6387fa001f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:17.677892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e3692e4d0e4892abab3d6387fa001f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:17.690176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e3692e4d0e4892abab3d6387fa001f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:17.696186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1150/2286] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:52:17 2022] DELETE /identity/v3/users/61e3692e4d0e4892abab3d6387fa001f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:17.877203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:17.888209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af783b07-54fe-493d-adec-1be3c692379c service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:17.953098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:17.953734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:17.954006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:17.954271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] PATH_INFO: `/v3/projects/94a5d3bae03c4e178cdc666b72432624` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:17.955407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a5d3bae03c4e178cdc666b72432624)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:17.957311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:17.989571 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:17.990663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.007395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a5d3bae03c4e178cdc666b72432624', 'request_id': 'req-55f9eecf-a08e-4f05-afb2-bf6a72e20555'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:18.014015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a5d3bae03c4e178cdc666b72432624', 'request_id': 'req-55f9eecf-a08e-4f05-afb2-bf6a72e20555'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:18.020486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a5d3bae03c4e178cdc666b72432624', 'request_id': 'req-55f9eecf-a08e-4f05-afb2-bf6a72e20555'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:18.034602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] The token cache is being invalidate because project 94a5d3bae03c4e178cdc666b72432624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:52:18.034931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:18.035564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55f9eecf-a08e-4f05-afb2-bf6a72e20555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:18.037087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1137/2287] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:52:17 2022] DELETE /identity/v3/projects/94a5d3bae03c4e178cdc666b72432624 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:18.041960 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849c5a-e74a-4da5-83fa-ecfb0b734dbf None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.042242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849c5a-e74a-4da5-83fa-ecfb0b734dbf None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.042519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81849c5a-e74a-4da5-83fa-ecfb0b734dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.048944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1b85d-f35a-40db-8128-d090fa6be1d1 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.061498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-81849c5a-e74a-4da5-83fa-ecfb0b734dbf None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:18.062723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-81849c5a-e74a-4da5-83fa-ecfb0b734dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.083712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:18.098057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.098939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.099224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.099498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.101366 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.140014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1138/2288] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:52:18.140242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:18.143060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.143563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.143916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.169278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:18.170499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.178841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1139/2289] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:52:18.179683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.180937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.186446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.187924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.192848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b720-b505-4374-9b7b-15189b5282d2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.196755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.197449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.197802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.198258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.200638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.202853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1151/2290] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:52:18.204000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.216667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.216843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533dc197-fb11-4cf5-924f-28691a2056d4 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.217950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.221496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.222201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.222573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.222928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.223652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:52:18.224018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.225704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.232526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1140/2291] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:18.241248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1152/2292] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:52:18.245717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.260078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db6854-385e-4895-8420-0b4dbff867bc service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.264910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.265626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.266084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.266422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.267218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.276648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.325357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1141/2293] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:52:18.326639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.337579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686edc0-399a-47fa-b416-b67802dada74 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.412391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.412991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.413265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.413662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.414280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.416197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.438697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1153/2294] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:52:18.442935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.453196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a8f50-6d37-4ada-9144-487be4a53224 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.458256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.458876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.459153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.459509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.460052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.461638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.471450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1142/2295] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:18.476108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.489807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b69be-e417-49a2-94ac-62ae6cfe83c4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.494896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6b36c-b005-40ab-8f83-bd887f1bd0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.495539 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b36c-b005-40ab-8f83-bd887f1bd0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.495871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b36c-b005-40ab-8f83-bd887f1bd0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.496146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6b36c-b005-40ab-8f83-bd887f1bd0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.496849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b36c-b005-40ab-8f83-bd887f1bd0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.498570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6b36c-b005-40ab-8f83-bd887f1bd0d2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.510385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1154/2296] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:18.514984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.525899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7050f-aab2-41fa-8d3c-f1409f85261a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.531255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.531921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.532221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.532480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] PATH_INFO: `/v3/projects/847fad11bc87401ab2f219fca7a2bee9/users/e5fac11d36dc4cf5a35a9c5dc3edeb33/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.549160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847fad11bc87401ab2f219fca7a2bee9, user_id=e5fac11d36dc4cf5a35a9c5dc3edeb33, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.551897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.568657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1143/2297] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:52:18 2022] PUT /identity/v3/projects/847fad11bc87401ab2f219fca7a2bee9/users/e5fac11d36dc4cf5a35a9c5dc3edeb33/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:18.578895 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.579269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.579540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.613557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] MFA Rules not processed for user `e5fac11d36dc4cf5a35a9c5dc3edeb33`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:18.614870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:18.678930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1155/2298] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:18.685719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.882503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c3dbd-b2b4-40ce-aa12-97b9230fe976 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.888594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:18.889211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:18.889486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:18.889759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:18.890393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:18.892333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:18.920699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1144/2299] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/projects => generated 369 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:52:18.924559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:18.935886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb5580-2b95-4dbb-99c0-e44038ae28e6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:18.948224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:19.003325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.004078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.004475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.004839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.005575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.007640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.032889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1156/2300] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:52:18 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:52:19.034090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:19.045343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9100a94-d699-48e3-b501-68e85ff8ddad admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:19.050213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.050867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.051141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.051424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.052058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.053691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.065440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1145/2301] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:19.070008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:19.081406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5ac70-c55f-4895-b2e9-a1cd8def31f5 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:19.087331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.088181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.088740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.089025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] PATH_INFO: `/v3/projects/671fc3147d6b4a4685aec7e46267f38b/users/54dbbabcf84648ffb443edbd7bbe1fd9/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.108036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=671fc3147d6b4a4685aec7e46267f38b, user_id=54dbbabcf84648ffb443edbd7bbe1fd9, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.111047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.125578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1157/2302] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:52:19 2022] PUT /identity/v3/projects/671fc3147d6b4a4685aec7e46267f38b/users/54dbbabcf84648ffb443edbd7bbe1fd9/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:19.129707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:19.139574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd28433-e84e-4651-9bea-6100faf72f78 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:19.158584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:19.200775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8daa1e3-fc67-4a6c-bab3-025981338d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.201396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daa1e3-fc67-4a6c-bab3-025981338d8b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.201651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daa1e3-fc67-4a6c-bab3-025981338d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.201913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8daa1e3-fc67-4a6c-bab3-025981338d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.202574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daa1e3-fc67-4a6c-bab3-025981338d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.204169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8daa1e3-fc67-4a6c-bab3-025981338d8b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.214397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1146/2303] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:19.219038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:19.230412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6d27-9a2f-4648-953d-32d93302c02e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:19.236663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.237337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.237613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.237882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] PATH_INFO: `/v3/projects/671fc3147d6b4a4685aec7e46267f38b/users/54dbbabcf84648ffb443edbd7bbe1fd9/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.240065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671fc3147d6b4a4685aec7e46267f38b, user_id=54dbbabcf84648ffb443edbd7bbe1fd9, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.242774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.254343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1158/2304] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:52:19 2022] PUT /identity/v3/projects/671fc3147d6b4a4685aec7e46267f38b/users/54dbbabcf84648ffb443edbd7bbe1fd9/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:19.266473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b975a-bcf9-441e-b741-98149523d544 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.266791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b975a-bcf9-441e-b741-98149523d544 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.267136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b975a-bcf9-441e-b741-98149523d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.308257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-232b975a-bcf9-441e-b741-98149523d544 None None] MFA Rules not processed for user `54dbbabcf84648ffb443edbd7bbe1fd9`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:19.310019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-232b975a-bcf9-441e-b741-98149523d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:19.397767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1147/2305] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:19.409686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:19.411514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:19.477030 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69012b-9193-46d6-8ec9-07b90f20c313 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:19.481626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a6fa7-c4b8-495e-8516-94d8c915454b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.482150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6fa7-c4b8-495e-8516-94d8c915454b service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.482422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6fa7-c4b8-495e-8516-94d8c915454b service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.482709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a6fa7-c4b8-495e-8516-94d8c915454b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.495623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a6fa7-c4b8-495e-8516-94d8c915454b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.497080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a6fa7-c4b8-495e-8516-94d8c915454b service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.507727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1159/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:19.586058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b975a-bcf9-441e-b741-98149523d544 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:19.595743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b975a-bcf9-441e-b741-98149523d544 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:19.599212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:19.599817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:19.600088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:19.600353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:19.660270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:19.661652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:19.670916 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1148/2307] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:26.049071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:26.049490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:26.049635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:26.068992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:26.070185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:26.142479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1160/2308] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:52:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:26.195598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:26.197149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:26.243919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:26.278259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47801d-a2f5-4b2f-a1f8-0588a1923467 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:26.283776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:26.284376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:26.284650 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:26.284921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:26.293017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:26.294647 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:26.302438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1149/2309] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:52:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:52:36.112191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:36.113735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:36.137288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:36.191829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f1978-1fd2-4db1-862b-22d71bc0e575 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:36.197573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:36.198183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:36.198460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:36.198766 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:36.200566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:36.259833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:36.261436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f68e0-c168-4c81-a7a9-e430775d3171 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:36.270546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1161/2310] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:36.299275 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=13 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:39.630413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:39.632088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:39.699676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d950-0db9-4121-b7b1-36e0b1fcda08 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:39.703697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:39.704305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:39.704583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:39.704852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:39.707130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:39.718034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:39.719493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060bc5f-b52a-48fc-8918-fc30ec9605cb service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:39.727633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1150/2311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:39.851819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d525-ad8f-411a-8d26-48b2057386f9 None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:39.853752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d525-ad8f-411a-8d26-48b2057386f9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:39.854716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67d525-ad8f-411a-8d26-48b2057386f9 None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:39.856386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1162/2312] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:52:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 10:52:39.863092 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35c4e4-0d09-4513-ae17-a23d55a4cc41 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:39.863409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35c4e4-0d09-4513-ae17-a23d55a4cc41 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:39.863700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35c4e4-0d09-4513-ae17-a23d55a4cc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:39.894238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-0b35c4e4-0d09-4513-ae17-a23d55a4cc41 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:39.895738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0b35c4e4-0d09-4513-ae17-a23d55a4cc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:39.908893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1151/2313] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:52:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:39.920083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d525-ad8f-411a-8d26-48b2057386f9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:39.922483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-eb67d525-ad8f-411a-8d26-48b2057386f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:40.006454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67d525-ad8f-411a-8d26-48b2057386f9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:40.010065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484afaa6-cb1d-4d9e-b3de-c6c347ae81c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:40.010810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484afaa6-cb1d-4d9e-b3de-c6c347ae81c8 service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.011173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484afaa6-cb1d-4d9e-b3de-c6c347ae81c8 service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.011509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484afaa6-cb1d-4d9e-b3de-c6c347ae81c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.022196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484afaa6-cb1d-4d9e-b3de-c6c347ae81c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:40.023795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484afaa6-cb1d-4d9e-b3de-c6c347ae81c8 service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:40.035222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1163/2314] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:40.108367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbca65-7a31-4413-9e60-fc39e0cc1d6d None None] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.108646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbca65-7a31-4413-9e60-fc39e0cc1d6d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.108921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbca65-7a31-4413-9e60-fc39e0cc1d6d None None] PATH_INFO: `/` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.110301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1152/2315] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:52:40.115220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc976e2-1126-4798-9525-0e1ac054a77e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.115501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc976e2-1126-4798-9525-0e1ac054a77e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.115768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc976e2-1126-4798-9525-0e1ac054a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.135326 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1dc976e2-1126-4798-9525-0e1ac054a77e None None] MFA Rules not processed for user `afcf59c6d1954210abe8421b9a5b49ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:40.136553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1dc976e2-1126-4798-9525-0e1ac054a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:40.143403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1164/2316] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:40.158902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbca65-7a31-4413-9e60-fc39e0cc1d6d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:40.173393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbca65-7a31-4413-9e60-fc39e0cc1d6d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:40.177739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e3cb7-9598-4d33-a422-dcc4a246158e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:40.178820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e3cb7-9598-4d33-a422-dcc4a246158e service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.179349 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e3cb7-9598-4d33-a422-dcc4a246158e service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.179847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e3cb7-9598-4d33-a422-dcc4a246158e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.190364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e3cb7-9598-4d33-a422-dcc4a246158e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:40.191884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e3cb7-9598-4d33-a422-dcc4a246158e service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:40.200101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1153/2317] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:40.294511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f696a0-d3fe-4caf-ab72-dcec00ccc05c None None] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.294872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f696a0-d3fe-4caf-ab72-dcec00ccc05c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.295150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f696a0-d3fe-4caf-ab72-dcec00ccc05c None None] PATH_INFO: `/` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.296642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1165/2318] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 10:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 10:52:40.303079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.303365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.303710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.323865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] MFA Rules not processed for user `e37ccc38bfcb43288a9f451428d293e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:40.325062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:40.334962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1154/2319] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 10:52:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:52:40.345551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f696a0-d3fe-4caf-ab72-dcec00ccc05c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:40.358229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f696a0-d3fe-4caf-ab72-dcec00ccc05c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:40.362673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:40.363328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.363603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.363872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.373897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:40.375429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:40.386549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1166/2320] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:40.451085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:40.452642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:40.526520 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d74a2-df22-4758-ba16-37d9ff3fd2d9 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:40.532303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:40.532798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:40.533070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:40.533333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:40.535167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:40.546443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:40.548058 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5724f-dc4b-408b-83fb-921781a77648 service placement] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:40.557766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1155/2321] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:41.453340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:41.462072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb3c61-dfbd-4011-adc0-ca840e4727f6 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:41.465712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:41.466353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:41.466783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:41.467040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:41.468727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:41.478639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:41.480123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:41.488797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1167/2322] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:42.598234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:42.598718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:42.599030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:42.624737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:42.626302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:42.634149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1156/2323] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:42.647070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:42.659169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b4373-a3ad-4daa-9473-87f17ece77f6 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:42.664881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:42.665511 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:42.665787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:42.666086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:42.675943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:42.676724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:42.684987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1168/2324] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:52:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:52:43.562114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:43.575420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41db400-ca49-4bde-a210-4037beb9694b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:43.586784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:43.587406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:43.587678 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:43.587946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:43.589715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:43.668428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:43.670054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc16eed-070d-4410-bcd1-45d12a823fa2 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:43.675133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:43.683814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1157/2325] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:49.945360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:49.977224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:50.036763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894c7cb-9144-4d75-9882-08af3290f5f8 service swift] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:50.041713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:50.042368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:50.042648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:50.042948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] PATH_INFO: `/v3/users/e5fac11d36dc4cf5a35a9c5dc3edeb33` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:50.044133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fac11d36dc4cf5a35a9c5dc3edeb33)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:50.046130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:50.099400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fac11d36dc4cf5a35a9c5dc3edeb33'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.106741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fac11d36dc4cf5a35a9c5dc3edeb33'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.116554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fac11d36dc4cf5a35a9c5dc3edeb33'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.117263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fac11d36dc4cf5a35a9c5dc3edeb33'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.130358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fac11d36dc4cf5a35a9c5dc3edeb33'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.136653 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1169/2326] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:52:49 2022] DELETE /identity/v3/users/e5fac11d36dc4cf5a35a9c5dc3edeb33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:52:50.141344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:50.141885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:50.141986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:50.161272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:50.162505 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:50.225201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1158/2327] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:50.235276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:50.236727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:50.296828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd729-dae5-42c6-8de5-447448796c72 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:50.303152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:50.304026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:50.304380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:50.304737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:50.317900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:50.319386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:50.329270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1170/2328] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:50.618718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:50.620439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:50.634169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e056-14ca-4dfe-ac7f-0eac1e6850e8 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:50.639771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:50.640496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:50.640966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:50.641226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] PATH_INFO: `/v3/projects/847fad11bc87401ab2f219fca7a2bee9` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:50.642486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847fad11bc87401ab2f219fca7a2bee9)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:50.644584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:50.699430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847fad11bc87401ab2f219fca7a2bee9', 'request_id': 'req-c64e329e-699b-418b-a8ed-97e586ac884a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.705361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847fad11bc87401ab2f219fca7a2bee9', 'request_id': 'req-c64e329e-699b-418b-a8ed-97e586ac884a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.712368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847fad11bc87401ab2f219fca7a2bee9', 'request_id': 'req-c64e329e-699b-418b-a8ed-97e586ac884a'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.726619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] The token cache is being invalidate because project 847fad11bc87401ab2f219fca7a2bee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:52:50.726949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.727569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.729066 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1159/2329] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:52:50 2022] DELETE /identity/v3/projects/847fad11bc87401ab2f219fca7a2bee9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:50.733434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:50.743866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff16309-3d3a-40c8-bb49-95f07b36b414 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:50.793334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:50.830996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:50.831852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:50.832222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:50.832546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] PATH_INFO: `/v3/users/54dbbabcf84648ffb443edbd7bbe1fd9` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:50.833779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54dbbabcf84648ffb443edbd7bbe1fd9)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:50.835809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:50.897305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54dbbabcf84648ffb443edbd7bbe1fd9'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.904476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54dbbabcf84648ffb443edbd7bbe1fd9'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.912769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54dbbabcf84648ffb443edbd7bbe1fd9'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.913624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54dbbabcf84648ffb443edbd7bbe1fd9'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.926118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9de8360a-032b-4a67-bce7-485dbce69d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54dbbabcf84648ffb443edbd7bbe1fd9'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:50.932385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1171/2330] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:52:50 2022] DELETE /identity/v3/users/54dbbabcf84648ffb443edbd7bbe1fd9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:51.209417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.211194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:51.225834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e329e-699b-418b-a8ed-97e586ac884a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.284719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.285358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.285631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.285939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] PATH_INFO: `/v3/projects/671fc3147d6b4a4685aec7e46267f38b` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.287109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671fc3147d6b4a4685aec7e46267f38b)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.289011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.313764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:51.340188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671fc3147d6b4a4685aec7e46267f38b', 'request_id': 'req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:51.346076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671fc3147d6b4a4685aec7e46267f38b', 'request_id': 'req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:51.352299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671fc3147d6b4a4685aec7e46267f38b', 'request_id': 'req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:51.365472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] The token cache is being invalidate because project 671fc3147d6b4a4685aec7e46267f38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:52:51.365757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:51.366385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bfe237ca-b1a1-41f7-ba3c-2d6d05abf252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:51.367866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1160/2331] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:52:51 2022] DELETE /identity/v3/projects/671fc3147d6b4a4685aec7e46267f38b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:52:51.373154 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.373612 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.373737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.393473 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:51.394696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:51.461324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1172/2332] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:51.469972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.470258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.470532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.491109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:51.492319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:51.500783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1161/2333] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:51.505271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.515813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58de9ad-9db3-4f3e-941b-c605379849ff None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.522231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.522858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.523100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.523364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.524063 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:52:51.524360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.526021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.538646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1173/2334] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:52:51.543208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.553089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8791ca-456b-4d8d-b206-9fe7dcd146aa None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.558546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.559212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.559491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.559763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.560415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.562330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.597186 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1162/2335] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:52:51 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:52:51.598497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.609384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916739b7-f08c-4d7b-ba4f-4ce11015dac5 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.648306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:51.668709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.669325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.669598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.669849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.670579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.672503 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.698922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1174/2336] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:52:51 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:52:51.700408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.712421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0a16c-134a-48c0-8492-e6a2e15fb58c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.718178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.718821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.719098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.719364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.720048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.721730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.732565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1163/2337] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:51.737657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.751401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f740c2a-6658-4ffa-ba22-c1f0d5936752 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.756705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13206f-d53f-4a31-b758-cd595038fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.757356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13206f-d53f-4a31-b758-cd595038fc9b admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.757659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13206f-d53f-4a31-b758-cd595038fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.757932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13206f-d53f-4a31-b758-cd595038fc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.758624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13206f-d53f-4a31-b758-cd595038fc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.760546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13206f-d53f-4a31-b758-cd595038fc9b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.771941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1175/2338] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:51.776291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:51.786944 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ec0c7-508e-4d15-9eee-e71aec99ab8f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:51.792384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:51.793152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.793553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.793829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] PATH_INFO: `/v3/projects/8b1b828f458648dba1eb0437f136debe/users/d158cbd108d94e16aac6ca128300f357/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.808278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1b828f458648dba1eb0437f136debe, user_id=d158cbd108d94e16aac6ca128300f357, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:51.811264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:51.825747 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1164/2339] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:52:51 2022] PUT /identity/v3/projects/8b1b828f458648dba1eb0437f136debe/users/d158cbd108d94e16aac6ca128300f357/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:51.837531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:51.837878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:51.838217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:51.869140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] MFA Rules not processed for user `d158cbd108d94e16aac6ca128300f357`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:51.870445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:51.958783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1176/2340] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:51.960921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.030697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094803df-d329-44ee-9066-416d83305f65 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.036470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.037078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.037351 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.037615 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.038237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.040158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.069397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1165/2341] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:52:51 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:52:52.073601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.084688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c91529-b6bc-4676-a763-c36c3c995806 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.141424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.141980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.142287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.142553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.143220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.145135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.166311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1177/2342] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:52:52 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:52:52.170475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.182331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc168f-5c41-49f7-bfca-f6070f4fb249 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.187783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.188412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.188684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.188936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.189632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.191301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.201966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1166/2343] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:52:52.207014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.220943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a33c4d-388d-4574-9f1d-c38171c34364 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.228216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.229860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.230128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.230710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] PATH_INFO: `/v3/projects/3a901e67dc32452f986cf4c3699b446e/users/095b433c0b694e8c81e934b4b7d3c11b/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.248750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a901e67dc32452f986cf4c3699b446e, user_id=095b433c0b694e8c81e934b4b7d3c11b, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.251618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.268888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1178/2344] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:52:52 2022] PUT /identity/v3/projects/3a901e67dc32452f986cf4c3699b446e/users/095b433c0b694e8c81e934b4b7d3c11b/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:52.273271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.283973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2acdce-9d64-4f7a-bb76-964b1f5b0541 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.302033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:52.350534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348dab2f-975d-4723-861c-8ccf03a1f422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.351180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dab2f-975d-4723-861c-8ccf03a1f422 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.351450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dab2f-975d-4723-861c-8ccf03a1f422 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.351712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348dab2f-975d-4723-861c-8ccf03a1f422 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.352353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dab2f-975d-4723-861c-8ccf03a1f422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.353917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348dab2f-975d-4723-861c-8ccf03a1f422 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.363934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1167/2345] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:52:52.368280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.378932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969a96f-6abe-4912-8c84-bdf284f951df admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.384084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.384757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.385033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.385305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] PATH_INFO: `/v3/projects/3a901e67dc32452f986cf4c3699b446e/users/095b433c0b694e8c81e934b4b7d3c11b/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.387301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a901e67dc32452f986cf4c3699b446e, user_id=095b433c0b694e8c81e934b4b7d3c11b, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.390054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.397097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:52.402044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1179/2346] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:52:52 2022] PUT /identity/v3/projects/3a901e67dc32452f986cf4c3699b446e/users/095b433c0b694e8c81e934b4b7d3c11b/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:52.412438 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.412712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.412975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.440343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] MFA Rules not processed for user `095b433c0b694e8c81e934b4b7d3c11b`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:52.441576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:52.519569 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1168/2347] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:52.531989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.534726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:52.601012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4f6a-55c2-4bc1-a71e-e37c0a57187c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.604930 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b26e12-94f9-4047-b6ea-76afab531491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.605591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b26e12-94f9-4047-b6ea-76afab531491 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.605860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b26e12-94f9-4047-b6ea-76afab531491 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.606148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b26e12-94f9-4047-b6ea-76afab531491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.617517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b26e12-94f9-4047-b6ea-76afab531491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.619029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b26e12-94f9-4047-b6ea-76afab531491 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.629898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1180/2348] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:52.713685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:52.715531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:52.729875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a1ed39-52e6-46af-9bdd-b9d2a2ad89e6 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:52.733926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:52.734695 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:52.735088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:52.735478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:52.799133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:52.800584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:52.809964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1169/2349] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:57.514090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:57.514610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:57.514777 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:57.535259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:57.536469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:57.594117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1181/2350] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:52:57.606499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:57.608021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:57.655523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:57.681209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fbf0b-f13c-46ca-ab15-73c562010f68 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:57.687715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:57.688204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:57.688475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:57.688750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:57.697591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:57.699225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:57.707614 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1170/2351] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:52:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 10:52:59.158788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:59.160418 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:59.235216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befe4a7-7830-4cd5-8758-aea327d2bac0 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:59.240705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:59.241311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:59.241581 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:59.241847 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:59.243564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:52:59.290592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:59.304818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:59.306423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7ff4d-1c45-4874-8df0-e28f77484050 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:59.315693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1182/2352] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:52:59.798401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:52:59.864527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13694e-88b1-4946-b643-a3bedcfa8756 service swift] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:52:59.869784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:52:59.870360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:59.870640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:59.870980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] PATH_INFO: `/v3/users/d158cbd108d94e16aac6ca128300f357` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:59.872207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d158cbd108d94e16aac6ca128300f357)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:52:59.874136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:52:59.923174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd158cbd108d94e16aac6ca128300f357'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:59.931662 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd158cbd108d94e16aac6ca128300f357'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:59.941305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd158cbd108d94e16aac6ca128300f357'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:59.942064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd158cbd108d94e16aac6ca128300f357'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:59.955643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd158cbd108d94e16aac6ca128300f357'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:52:59.961701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1171/2353] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:52:59 2022] DELETE /identity/v3/users/d158cbd108d94e16aac6ca128300f357 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:52:59.966611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:52:59.967148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:52:59.967425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:52:59.991007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:52:59.992231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:00.053750 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1183/2354] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:00.063705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:00.065344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:00.121999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac41e4c-dbdc-4c3d-b20d-a50a01c52364 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:00.125897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:00.126489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:00.126763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:00.127029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:00.133240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:00.137961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:00.139692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:00.150240 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1172/2355] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:00.414665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:00.416165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:00.430822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a230e-ad09-4935-89ed-c31927744c81 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:00.438343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:00.439026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:00.439284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:00.439553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] PATH_INFO: `/v3/projects/8b1b828f458648dba1eb0437f136debe` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:00.440768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1b828f458648dba1eb0437f136debe)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:00.442738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:00.493626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1b828f458648dba1eb0437f136debe', 'request_id': 'req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.499621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1b828f458648dba1eb0437f136debe', 'request_id': 'req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.505868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1b828f458648dba1eb0437f136debe', 'request_id': 'req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.519382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] The token cache is being invalidate because project 8b1b828f458648dba1eb0437f136debe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:00.519679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.520298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.522166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1184/2356] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:00 2022] DELETE /identity/v3/projects/8b1b828f458648dba1eb0437f136debe => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:00.526302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:00.536277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3303c7-ee30-4078-b398-7238a830c116 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:00.596965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:00.597601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:00.597903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:00.598953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] PATH_INFO: `/v3/users/095b433c0b694e8c81e934b4b7d3c11b` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:00.600519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095b433c0b694e8c81e934b4b7d3c11b)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:00.602482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:00.653711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095b433c0b694e8c81e934b4b7d3c11b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.662104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095b433c0b694e8c81e934b4b7d3c11b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.669498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095b433c0b694e8c81e934b4b7d3c11b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.670123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095b433c0b694e8c81e934b4b7d3c11b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.688783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d525a49-f50d-4cd9-b081-8badf8f1c093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095b433c0b694e8c81e934b4b7d3c11b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:00.695306 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1173/2357] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:00 2022] DELETE /identity/v3/users/095b433c0b694e8c81e934b4b7d3c11b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:00.989710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:00.994112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:01.019327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1dee7-e0d3-4aac-bc97-21ea329ab233 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.106909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.107553 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.107887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.108385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] PATH_INFO: `/v3/projects/3a901e67dc32452f986cf4c3699b446e` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.109310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a901e67dc32452f986cf4c3699b446e)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.111289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.123894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:01.165496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a901e67dc32452f986cf4c3699b446e', 'request_id': 'req-5639475a-57d9-472e-bced-78a6e050ed0a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:01.171078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a901e67dc32452f986cf4c3699b446e', 'request_id': 'req-5639475a-57d9-472e-bced-78a6e050ed0a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:01.177416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a901e67dc32452f986cf4c3699b446e', 'request_id': 'req-5639475a-57d9-472e-bced-78a6e050ed0a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:01.192345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] The token cache is being invalidate because project 3a901e67dc32452f986cf4c3699b446e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:01.192619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:01.193244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-5639475a-57d9-472e-bced-78a6e050ed0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:01.198654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1185/2358] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:00 2022] DELETE /identity/v3/projects/3a901e67dc32452f986cf4c3699b446e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:01.199839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.200254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.200393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.221124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:01.222542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:01.290511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1174/2359] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:01.299956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.300226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.300497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.321501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:01.322928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:01.331569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1186/2360] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:01.336201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.346523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0581746-8768-4a8e-bf18-15fb91e243fe None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.351525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.352129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.352649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.352649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.353332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:01.353652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.355396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.364521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:01.372896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1175/2361] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:53:01.379226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.388752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a37c05-ab46-4d15-8e39-a9a6c11777cb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.394874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.395496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.395900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.395999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.396925 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.398883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.429241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1187/2362] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:01.433537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.443774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467625-e599-405a-b037-83f2cde1ae70 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.499543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.500177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.500454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.500720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.501495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.503654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.527446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1176/2363] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:01.531560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.542738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25961f1b-d281-460c-83ae-33816ecb4543 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.548080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.548690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.548964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.549229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.549903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.551537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.562304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1188/2364] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:01.566425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.576690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9adfd-34da-4e21-af3e-d84a45d2f636 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.581360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176de1a-663c-4f69-bb15-d17bca29381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.581957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176de1a-663c-4f69-bb15-d17bca29381f admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.582232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176de1a-663c-4f69-bb15-d17bca29381f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.582497 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176de1a-663c-4f69-bb15-d17bca29381f admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.583172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176de1a-663c-4f69-bb15-d17bca29381f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.584760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176de1a-663c-4f69-bb15-d17bca29381f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.596726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1177/2365] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:01.600787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.611312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a492c08-5385-4add-bbda-5629bb961d16 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.615866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.616518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.616798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.617122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] PATH_INFO: `/v3/projects/86050dbecccc4c83b73a417d506eedcd/users/d4bbf1a1a7044f28b4d5e108ba1b4ee8/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.632037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=86050dbecccc4c83b73a417d506eedcd, user_id=d4bbf1a1a7044f28b4d5e108ba1b4ee8, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.634748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.649466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1189/2366] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:01 2022] PUT /identity/v3/projects/86050dbecccc4c83b73a417d506eedcd/users/d4bbf1a1a7044f28b4d5e108ba1b4ee8/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:01.659739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.660020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.660316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.690618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] MFA Rules not processed for user `d4bbf1a1a7044f28b4d5e108ba1b4ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:01.691848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:01.757406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1178/2367] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:01.763236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.832250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572d4fc-8c32-4b62-aae4-0b0f0e5f75ff admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.838017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.838642 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.838952 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.839221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.839850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.841767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.871265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1190/2368] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:01.875491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.886219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e660a-78ac-48d5-9d0b-e18997c83f28 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:01.954034 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:01.954595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:01.954901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:01.955174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:01.955795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:01.957730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:01.973628 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:01.980328 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1179/2369] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:01 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:01.984671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:01.995509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c7b27-0dfa-4f52-9d4d-c9a01c6cca4e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:02.001599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:02.002205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:02.002506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:02.002784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:02.003420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:02.005043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:02.016083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1191/2370] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:02.020549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:02.031209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2b1b4-7cba-4583-bd3e-0e51ec8c14d6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:02.036311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:02.036984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:02.037261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:02.037564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] PATH_INFO: `/v3/projects/23d70d8178ec4fc7bfba932a8393cf08/users/1b139c12487d4a65bd0d597885059288/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:02.052979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d70d8178ec4fc7bfba932a8393cf08, user_id=1b139c12487d4a65bd0d597885059288, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:02.055644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:02.069332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1180/2371] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:02 2022] PUT /identity/v3/projects/23d70d8178ec4fc7bfba932a8393cf08/users/1b139c12487d4a65bd0d597885059288/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:02.073280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:02.083300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77104-7c77-4c03-817c-cdce266ae88c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:02.089013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:02.146565 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506fa71-47d7-49b4-ad81-5c10ef4653a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:02.147230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506fa71-47d7-49b4-ad81-5c10ef4653a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:02.147507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506fa71-47d7-49b4-ad81-5c10ef4653a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:02.147779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506fa71-47d7-49b4-ad81-5c10ef4653a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:02.148425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506fa71-47d7-49b4-ad81-5c10ef4653a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:02.150028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506fa71-47d7-49b4-ad81-5c10ef4653a7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:02.160279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1192/2372] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:02.164267 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:02.174541 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0347f-a873-4559-86be-5fcbb673b1a9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:02.179220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:02.179861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:02.180136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:02.180406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] PATH_INFO: `/v3/projects/23d70d8178ec4fc7bfba932a8393cf08/users/1b139c12487d4a65bd0d597885059288/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:02.182303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d70d8178ec4fc7bfba932a8393cf08, user_id=1b139c12487d4a65bd0d597885059288, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:02.184985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:02.196395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1181/2373] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:02 2022] PUT /identity/v3/projects/23d70d8178ec4fc7bfba932a8393cf08/users/1b139c12487d4a65bd0d597885059288/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:02.207009 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:02.207203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:02.207504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:02.236547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] MFA Rules not processed for user `1b139c12487d4a65bd0d597885059288`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:02.237795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:02.306854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1193/2374] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:02.317813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:02.319786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:02.377142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42464ad-6969-4d55-b985-1d7f6f9cca34 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:02.381535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27251b-eae1-4cdd-843e-3f3880416072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:02.382171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27251b-eae1-4cdd-843e-3f3880416072 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:02.382412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27251b-eae1-4cdd-843e-3f3880416072 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:02.382714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27251b-eae1-4cdd-843e-3f3880416072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:02.392740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27251b-eae1-4cdd-843e-3f3880416072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:02.394189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27251b-eae1-4cdd-843e-3f3880416072 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:02.404050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1182/2375] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:02.972410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:03.037296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130743f-c2a7-43ca-aaf4-ecbf61d07a30 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:03.042654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:03.043319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:03.043590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:03.043853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] PATH_INFO: `/v3/users/d4bbf1a1a7044f28b4d5e108ba1b4ee8` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:03.045125 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bbf1a1a7044f28b4d5e108ba1b4ee8)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:03.047229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:03.089102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:03.102229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bbf1a1a7044f28b4d5e108ba1b4ee8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.109185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bbf1a1a7044f28b4d5e108ba1b4ee8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.118450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bbf1a1a7044f28b4d5e108ba1b4ee8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.119353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bbf1a1a7044f28b4d5e108ba1b4ee8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.131077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bbf1a1a7044f28b4d5e108ba1b4ee8'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.137027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1194/2376] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:02 2022] DELETE /identity/v3/users/d4bbf1a1a7044f28b4d5e108ba1b4ee8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:03.141860 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:03.142138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:03.142420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:03.162421 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:03.163930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:03.224350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1183/2377] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:03.234147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:03.235700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:03.295555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbdca6-3fca-4f0b-a603-1f4371a6d8b1 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:03.299564 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:03.300162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:03.300436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:03.300696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:03.309691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:03.311151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:03.320472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1195/2378] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:03.828288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:03.829787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:03.841706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c8c57-9e1c-4e78-9a84-f74a07d5e5fd None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:03.846918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:03.847556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:03.847847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:03.848258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] PATH_INFO: `/v3/projects/86050dbecccc4c83b73a417d506eedcd` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:03.849398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86050dbecccc4c83b73a417d506eedcd)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:03.851477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:03.906378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86050dbecccc4c83b73a417d506eedcd', 'request_id': 'req-87ab224a-9742-4ce0-83de-c8c9edc10b53'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.912303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86050dbecccc4c83b73a417d506eedcd', 'request_id': 'req-87ab224a-9742-4ce0-83de-c8c9edc10b53'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.913423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:03.919115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86050dbecccc4c83b73a417d506eedcd', 'request_id': 'req-87ab224a-9742-4ce0-83de-c8c9edc10b53'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.936892 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] The token cache is being invalidate because project 86050dbecccc4c83b73a417d506eedcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:03.937185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.938089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:03.942604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1184/2379] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:03 2022] DELETE /identity/v3/projects/86050dbecccc4c83b73a417d506eedcd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:03.945845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:03.955080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24d5a1-80e7-464d-afd5-7d733dceef5a service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:04.021459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:04.022204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.022479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.022775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] PATH_INFO: `/v3/users/1b139c12487d4a65bd0d597885059288` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.023902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b139c12487d4a65bd0d597885059288)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:04.025887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:04.084608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b139c12487d4a65bd0d597885059288'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.093175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:04.095486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b139c12487d4a65bd0d597885059288'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.105466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b139c12487d4a65bd0d597885059288'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.106253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b139c12487d4a65bd0d597885059288'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.131365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c7a17a76-fc9d-4c2b-8dab-81d28f33597e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b139c12487d4a65bd0d597885059288'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.137552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1196/2380] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:03 2022] DELETE /identity/v3/users/1b139c12487d4a65bd0d597885059288 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:04.418732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:04.420442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:04.448158 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab224a-9742-4ce0-83de-c8c9edc10b53 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:04.522316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:04.523157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.523528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.524120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] PATH_INFO: `/v3/projects/23d70d8178ec4fc7bfba932a8393cf08` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.525770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d70d8178ec4fc7bfba932a8393cf08)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:04.527950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:04.587958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d70d8178ec4fc7bfba932a8393cf08', 'request_id': 'req-c4324035-430e-4047-93d3-ea66f7ab95b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.593924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d70d8178ec4fc7bfba932a8393cf08', 'request_id': 'req-c4324035-430e-4047-93d3-ea66f7ab95b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.602772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d70d8178ec4fc7bfba932a8393cf08', 'request_id': 'req-c4324035-430e-4047-93d3-ea66f7ab95b8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.619712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] The token cache is being invalidate because project 23d70d8178ec4fc7bfba932a8393cf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:04.619712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.620834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-c4324035-430e-4047-93d3-ea66f7ab95b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:04.622485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1185/2381] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:04 2022] DELETE /identity/v3/projects/23d70d8178ec4fc7bfba932a8393cf08 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:04.628065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.628638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.629132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.660261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:04.661585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:04.741390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1197/2382] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:04.750181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.750380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.750744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.777190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:04.778775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:04.788299 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1186/2383] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:04.792600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:04.806324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b3ce4-8a82-4ea2-a0c1-ecf19a845c86 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:04.812694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:04.813500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.813770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.814042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.814698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:04.815001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:04.816651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:04.829730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1198/2384] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:04.834022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:04.843313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbfdb8-56cf-41ac-9b48-cf513961d8f2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:04.848230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:04.848823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.849097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.849357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.849992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:04.851920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:04.884250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1187/2385] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:04 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:04.885464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:04.895875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ffd79-34ee-40da-92b3-8ad037eff60e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:04.955357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:04.955976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:04.956250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:04.956518 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:04.957152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:04.959114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:04.987361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1199/2386] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:04 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:04.991553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.002556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2e6cf-8e0d-46f4-957b-429054f23df4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.007580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.008367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.008759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.009021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.009698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.011359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.023576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1188/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:05.027694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.038017 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8c1a5-ce74-488b-9dbb-5f56343cde3d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.047787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.048585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.049012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.049357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.050341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.052127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.055706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.062965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:05.068983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1200/2388] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:05.070301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.082951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38fd76-71e3-4019-b91a-91c8792b9058 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.090203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c206984f-a6db-499e-b0c8-86bb8cc9d6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.091273 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206984f-a6db-499e-b0c8-86bb8cc9d6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.091906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206984f-a6db-499e-b0c8-86bb8cc9d6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.092403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206984f-a6db-499e-b0c8-86bb8cc9d6d0 admin admin] PATH_INFO: `/v3/projects/ab83f41f089142029d0e28f41bccee96/users/d37985a3531a44f290f851d83e2ead2d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.114227 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206984f-a6db-499e-b0c8-86bb8cc9d6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab83f41f089142029d0e28f41bccee96, user_id=d37985a3531a44f290f851d83e2ead2d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.118033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c206984f-a6db-499e-b0c8-86bb8cc9d6d0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.144678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1201/2389] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:05 2022] PUT /identity/v3/projects/ab83f41f089142029d0e28f41bccee96/users/d37985a3531a44f290f851d83e2ead2d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:05.157034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.157339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.157609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.196897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:05.226620 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:05.232647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] MFA Rules not processed for user `d37985a3531a44f290f851d83e2ead2d`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:05.239559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:05.302769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5704de5-a7d0-4b6a-9f8a-674e66b31294 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.354721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1202/2390] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:05.367120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.368955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:05.393929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.394655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.395551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.395901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.398786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:05.414723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.416325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.427454 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1189/2391] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:05.431132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e49d1e-038f-44f6-8647-e727e690ef12 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.435057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb6272-5047-46a6-b3ea-01098c644d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.436116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb6272-5047-46a6-b3ea-01098c644d46 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.436396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb6272-5047-46a6-b3ea-01098c644d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.436666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb6272-5047-46a6-b3ea-01098c644d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.446860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb6272-5047-46a6-b3ea-01098c644d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.448344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb6272-5047-46a6-b3ea-01098c644d46 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.460994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1203/2392] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:05.481068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.543315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0e8e9-80f2-4897-977a-677da5548f83 service nova] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.547969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.548592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.548862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.549191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] PATH_INFO: `/v3/users/d37985a3531a44f290f851d83e2ead2d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.550341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37985a3531a44f290f851d83e2ead2d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.552318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.607406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37985a3531a44f290f851d83e2ead2d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:05.619760 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37985a3531a44f290f851d83e2ead2d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:05.628123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37985a3531a44f290f851d83e2ead2d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:05.629392 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37985a3531a44f290f851d83e2ead2d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:05.631056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:05.648019 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37985a3531a44f290f851d83e2ead2d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:05.654828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1190/2393] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:05 2022] DELETE /identity/v3/users/d37985a3531a44f290f851d83e2ead2d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:05.659457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.659742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.660038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.683344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:05.684809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:05.759967 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1204/2394] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:05.772638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:05.774514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:05.855429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1c0b9-ab04-4fca-a2b7-30f8cba616e4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:05.868463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c10a4d-9057-49ba-a298-7d28f1b830cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:05.869227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c10a4d-9057-49ba-a298-7d28f1b830cd service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:05.869570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c10a4d-9057-49ba-a298-7d28f1b830cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:05.869911 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c10a4d-9057-49ba-a298-7d28f1b830cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:05.881156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c10a4d-9057-49ba-a298-7d28f1b830cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:05.882774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c10a4d-9057-49ba-a298-7d28f1b830cd service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:05.893556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1191/2395] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:06.273352 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.275815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:06.303746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a8cbf-3ff1-449a-9fc3-d220f7442b77 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.308792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.309432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.309708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.309974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] PATH_INFO: `/v3/projects/ab83f41f089142029d0e28f41bccee96` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.311373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab83f41f089142029d0e28f41bccee96)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.313477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.361305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:06.369994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab83f41f089142029d0e28f41bccee96', 'request_id': 'req-fa0101e7-141c-4f61-ab48-4a55bae157c3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:06.376739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab83f41f089142029d0e28f41bccee96', 'request_id': 'req-fa0101e7-141c-4f61-ab48-4a55bae157c3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:06.383554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab83f41f089142029d0e28f41bccee96', 'request_id': 'req-fa0101e7-141c-4f61-ab48-4a55bae157c3'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:06.397522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] The token cache is being invalidate because project ab83f41f089142029d0e28f41bccee96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:06.397805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:06.398426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fa0101e7-141c-4f61-ab48-4a55bae157c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:06.400052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1205/2396] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:06 2022] DELETE /identity/v3/projects/ab83f41f089142029d0e28f41bccee96 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:06.405003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.406488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.406908 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.427108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:06.428436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:06.491475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1192/2397] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:06.498245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.498524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.498829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.526355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:06.527770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:06.536448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1206/2398] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:06.540672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.550977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11516f4-5642-4ecd-ba8d-713791b76b1e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.555430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.556057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.556329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.556595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.557237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:06.557562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.559188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.576248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1193/2399] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:06.577437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.587096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df92d1f-6800-4d25-a82b-7392f44d8bd6 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.592468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.593068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.593339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.593605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.594398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.596371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.629112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1207/2400] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:06 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:06.630537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.641222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91039e0-4878-4642-9197-b3dd06644cee admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.703607 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.704237 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.704511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.704778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.705405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.707436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.725485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:06.731380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1194/2401] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:06 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:06.735670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.747046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e2628-540d-47e9-8e06-00977ee1165a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.752921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.753546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.753824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.754101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.754789 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.756412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.769610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1208/2402] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:06.770794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.781364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d5603-cdc4-46e3-a201-e70787ba9c2c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.786227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eb2da-d1dc-4116-9b7b-1f0a0b28027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.786859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eb2da-d1dc-4116-9b7b-1f0a0b28027b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.787258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eb2da-d1dc-4116-9b7b-1f0a0b28027b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.787558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eb2da-d1dc-4116-9b7b-1f0a0b28027b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.788200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eb2da-d1dc-4116-9b7b-1f0a0b28027b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.789799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eb2da-d1dc-4116-9b7b-1f0a0b28027b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.800583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1195/2403] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:06.804773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.816410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9d229-7c47-4008-8a42-6f4bc823225b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:06.821568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:06.822232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.822501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.822804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] PATH_INFO: `/v3/projects/0c0d9bbef73e4de9a9c76eec3c375cf6/users/7faf78fceb944937b69c51429d9af273/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.843268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0d9bbef73e4de9a9c76eec3c375cf6, user_id=7faf78fceb944937b69c51429d9af273, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:06.846838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:06.861100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1209/2404] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:06 2022] PUT /identity/v3/projects/0c0d9bbef73e4de9a9c76eec3c375cf6/users/7faf78fceb944937b69c51429d9af273/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:06.872623 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:06.873149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:06.873149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:06.902499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] MFA Rules not processed for user `7faf78fceb944937b69c51429d9af273`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:06.903762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:06.971527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1196/2405] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:06.983385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:06.985283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:07.050602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352362-efea-44db-bf4a-1b524ab03060 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:07.054235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:07.055138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:07.055279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:07.055451 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:07.065703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:07.067216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:07.085658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1210/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:10.535318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:10.536953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:10.595790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6ec77-6072-4437-b248-0a2365becc66 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:10.599930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:10.600532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:10.600808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:10.601072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:10.603206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:10.668524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:10.670027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:10.681143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1197/2407] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:14.040345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.041841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.150026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cf98c-320d-4005-872b-ff2fdf92bdca service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:14.150170 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.151835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.164598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:14.165629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.166058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.166496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.177552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f622-8b0c-46b9-99f3-1ba5518ec492 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:14.178904 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.183214 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:14.183969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.184507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.184983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] PATH_INFO: `/v3/users/afd753e2b6534bfc8f015ab1e9ed939d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.187195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd753e2b6534bfc8f015ab1e9ed939d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:14.189479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:14.195189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:14.197014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:14.203542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:14.214236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1211/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:14.215240 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.217100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.231067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:14.244264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d311a-e400-410a-9932-8a5dc132ca0e service placement] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:14.249088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:14.250056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.250328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.250645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.253211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.274621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:14.279226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:14.288841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd753e2b6534bfc8f015ab1e9ed939d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.294213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1212/2409] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:14.305020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd753e2b6534bfc8f015ab1e9ed939d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.320015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd753e2b6534bfc8f015ab1e9ed939d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.321233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd753e2b6534bfc8f015ab1e9ed939d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.336962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f651d38b-16f6-4c12-b9d3-bb1f81cd2cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd753e2b6534bfc8f015ab1e9ed939d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.346127 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1198/2410] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:14 2022] DELETE /identity/v3/users/afd753e2b6534bfc8f015ab1e9ed939d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:14.540480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.551513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37657da-4da5-4856-8f78-7e1df1bc13cd service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:14.623709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:14.624351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.624632 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.624964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] PATH_INFO: `/v3/projects/8ceb3a17be2e4fd78ebf638c58325f38` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.626119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ceb3a17be2e4fd78ebf638c58325f38)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:14.628147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:14.678968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ceb3a17be2e4fd78ebf638c58325f38', 'request_id': 'req-f8bc4186-49cb-4b1f-94f6-933f274575e2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.684669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ceb3a17be2e4fd78ebf638c58325f38', 'request_id': 'req-f8bc4186-49cb-4b1f-94f6-933f274575e2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.691377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ceb3a17be2e4fd78ebf638c58325f38', 'request_id': 'req-f8bc4186-49cb-4b1f-94f6-933f274575e2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.705110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] The token cache is being invalidate because project 8ceb3a17be2e4fd78ebf638c58325f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:14.705406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.706044 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f8bc4186-49cb-4b1f-94f6-933f274575e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:14.707578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1213/2411] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:14 2022] DELETE /identity/v3/projects/8ceb3a17be2e4fd78ebf638c58325f38 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:14.713506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.714135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.714431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.735786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:14.737562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.801039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1199/2412] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:14.809048 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.809333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.809602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.829966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:14.831204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:14.839136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1214/2413] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:14.843889 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.853899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc362d8f-df4c-45aa-b872-16850ae51ba2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:14.859209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:14.859802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.860085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.860357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.861003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:14.861301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:14.862936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:14.875270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1200/2414] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:14.881137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.893548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a13a5-e970-4f68-b930-8c938755b961 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:14.899198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:14.899813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:14.900120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:14.900513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:14.901162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:14.903144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:14.932606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1215/2415] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:14 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:14.936999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:14.947009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076dd317-c2b0-4eee-b97a-d0a920db629c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:15.005341 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:15.005971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:15.006249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:15.006518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:15.007229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:15.009169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:15.032522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1201/2416] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:14 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:15.036850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:15.047934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215798-9ce4-4918-9a5f-d3342a4e53f8 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:15.053372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:15.053980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:15.054263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:15.054528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:15.055205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:15.056822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:15.067238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1216/2417] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:15.071524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:15.082385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb07c8-ac5a-43fd-a7d5-54bf24d49a77 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:15.088137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041cb96-218f-4f17-8f25-241831a56ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:15.088741 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041cb96-218f-4f17-8f25-241831a56ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:15.089015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041cb96-218f-4f17-8f25-241831a56ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:15.089286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041cb96-218f-4f17-8f25-241831a56ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:15.089937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041cb96-218f-4f17-8f25-241831a56ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:15.091588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041cb96-218f-4f17-8f25-241831a56ba0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:15.102358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1202/2418] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:15.106585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:15.116722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e98b49-a94f-48e5-84d4-3418caad7c02 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:15.121522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:15.122174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:15.122454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:15.122761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] PATH_INFO: `/v3/projects/e453f77090834404b57d7f404450c720/users/54ada119bf8e4580b36667721af11041/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:15.138668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e453f77090834404b57d7f404450c720, user_id=54ada119bf8e4580b36667721af11041, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:15.141401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:15.155176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1217/2419] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:15 2022] PUT /identity/v3/projects/e453f77090834404b57d7f404450c720/users/54ada119bf8e4580b36667721af11041/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:15.165596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:15.166608 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:15.166943 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:15.181698 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:15.199495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] MFA Rules not processed for user `54ada119bf8e4580b36667721af11041`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:15.201468 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:15.281595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1203/2420] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:15.293309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:15.295168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:15.313408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:15.383871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185dadd-00f0-425d-b77a-958bc831b5b6 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:15.395289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:15.395860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:15.396131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:15.396710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:15.405034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:15.406728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:15.416599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1218/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:17.563260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:17.564920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:17.631061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1f443-6440-4247-a76a-21f89131defe None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:17.635398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:17.636017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:17.636290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:17.636556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] PATH_INFO: `/v3/users/f1921e11db8e45e4af638755cc163823` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:17.637635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1921e11db8e45e4af638755cc163823)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:17.639578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:17.689245 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1921e11db8e45e4af638755cc163823'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.696653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1921e11db8e45e4af638755cc163823'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.711501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1921e11db8e45e4af638755cc163823'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.712948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1921e11db8e45e4af638755cc163823'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.718306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:17.720101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:17.727235 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1db2440f-07aa-41db-ac1e-cd2d56575e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1921e11db8e45e4af638755cc163823'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.733423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1204/2422] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:17 2022] DELETE /identity/v3/users/f1921e11db8e45e4af638755cc163823 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:17.734081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fc473-ba6c-4787-bd5d-8ce8192c631a service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:17.796940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:17.797710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:17.798057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:17.798434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] PATH_INFO: `/v3/users/7faf78fceb944937b69c51429d9af273` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:17.799693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=7faf78fceb944937b69c51429d9af273)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:17.801725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:17.850748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7faf78fceb944937b69c51429d9af273'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.858113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7faf78fceb944937b69c51429d9af273'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.866767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7faf78fceb944937b69c51429d9af273'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.867471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7faf78fceb944937b69c51429d9af273'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.879721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7faf78fceb944937b69c51429d9af273'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:17.886363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1219/2423] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:17 2022] DELETE /identity/v3/users/7faf78fceb944937b69c51429d9af273 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:17.892010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:17.892228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:17.892612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:17.916358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:17.917931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:17.925717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:17.927810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:17.928325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:17.950841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:17.991485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1205/2424] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:18.001694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.003271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.007483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d454b-d042-41ee-9fb9-14ee555524ca admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.012129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.012837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.013086 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.013353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] PATH_INFO: `/v3/projects/0763c9be032f4928b5ba8ac6cc9fe2be` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.014485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0763c9be032f4928b5ba8ac6cc9fe2be)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.016678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.064429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0763c9be032f4928b5ba8ac6cc9fe2be', 'request_id': 'req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.067682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd04eaf-0297-4de5-bc1a-1f229a22cab1 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.070579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0763c9be032f4928b5ba8ac6cc9fe2be', 'request_id': 'req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.077478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0763c9be032f4928b5ba8ac6cc9fe2be', 'request_id': 'req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.091533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] The token cache is being invalidate because project 0763c9be032f4928b5ba8ac6cc9fe2be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:18.091823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.092470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec2a8cd-72b1-4d1c-92c6-a986f817f839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.094043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1220/2425] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:17 2022] DELETE /identity/v3/projects/0763c9be032f4928b5ba8ac6cc9fe2be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:18.098999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbe8f-b77a-4225-9276-e161d1593012 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.099279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbe8f-b77a-4225-9276-e161d1593012 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.099555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdbe8f-b77a-4225-9276-e161d1593012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.118124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.118750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.118859 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2fbdbe8f-b77a-4225-9276-e161d1593012 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:18.119026 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.119294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.120083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2fbdbe8f-b77a-4225-9276-e161d1593012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.121511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.181448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1221/2426] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:18.192195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.192401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.192673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.192944 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.193862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.205364 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1206/2427] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:18.217918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.219617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.220202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:18.221698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.229929 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1222/2428] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:18.231759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35555-9c63-4e5d-b1ca-0aafb6867960 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.235343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.236784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.237423 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.237700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.237972 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] PATH_INFO: `/v3/users/54ada119bf8e4580b36667721af11041` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.239189 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ada119bf8e4580b36667721af11041)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.241053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.248884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d8914-fe64-483b-8c65-ad1706d07210 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.255209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.255910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.256267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.256599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.257408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:18.257908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.259844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.260626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:18.283907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1223/2429] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:18.288333 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.300458 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b4640-d920-4b18-a28c-d09d9d3c282b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.305377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ada119bf8e4580b36667721af11041'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.305844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.306800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.307191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.307372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.308354 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.310971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.319573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ada119bf8e4580b36667721af11041'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.327546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ada119bf8e4580b36667721af11041'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.328481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ada119bf8e4580b36667721af11041'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.346187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7a634c1b-4833-44d1-b796-33b5d02c3ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ada119bf8e4580b36667721af11041'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.347372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1224/2430] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:18.351121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.353027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.360136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:18.360324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1207/2431] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:18 2022] DELETE /identity/v3/users/54ada119bf8e4580b36667721af11041 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:18.362598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.364999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.367009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.391406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:18.392314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.442258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170c13-1792-49a3-acef-7effb0e5fc91 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.472229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1208/2432] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:18.483257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.484723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.505209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.505779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.506061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.506332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.507008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.509265 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.536555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1225/2433] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/users => generated 278 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:18.540699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.551313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e104e33f-de8b-4534-aa92-e608a6b36274 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.551589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985943f-4324-4855-a3cb-fd2d402acb11 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.555294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.555973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.556152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.556312 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.556651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.556770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.557089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.557368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.558409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.559719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.567096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.569153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.570988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1226/2434] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:18.575359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.581463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1209/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:18.588051 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652352f-067d-4a80-9554-ec8f74b6f9f1 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.593057 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.593730 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.594029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.594344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.595571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.596964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.602886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.604947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.611963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c899f1-9906-4325-bc6c-c4eba780be17 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.617697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.618514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1227/2436] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:18.618823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.619169 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.619446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] PATH_INFO: `/v3/projects/0c0d9bbef73e4de9a9c76eec3c375cf6` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.620629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0d9bbef73e4de9a9c76eec3c375cf6)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.622652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.622820 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.636303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25809b70-c31e-4b11-9a9a-e261f21e3a98 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.643033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a732c-5337-4472-9a13-6245d0da5c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.643778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a732c-5337-4472-9a13-6245d0da5c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.644053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a732c-5337-4472-9a13-6245d0da5c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.644374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a732c-5337-4472-9a13-6245d0da5c10 admin admin] PATH_INFO: `/v3/projects/7095f33fddc44ab49902976a1f1a5ba0/users/da4fdef99b25452aabcd93cd3a7f6dfb/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.661478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a732c-5337-4472-9a13-6245d0da5c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7095f33fddc44ab49902976a1f1a5ba0, user_id=da4fdef99b25452aabcd93cd3a7f6dfb, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.664915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a732c-5337-4472-9a13-6245d0da5c10 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.670446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:18.684778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1228/2437] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:18 2022] PUT /identity/v3/projects/7095f33fddc44ab49902976a1f1a5ba0/users/da4fdef99b25452aabcd93cd3a7f6dfb/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:18.685239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0d9bbef73e4de9a9c76eec3c375cf6', 'request_id': 'req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.692782 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0d9bbef73e4de9a9c76eec3c375cf6', 'request_id': 'req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.696170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.696613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.696988 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.700879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0d9bbef73e4de9a9c76eec3c375cf6', 'request_id': 'req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.718269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] The token cache is being invalidate because project 0c0d9bbef73e4de9a9c76eec3c375cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:18.718518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.720175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-850e27c9-22b7-4699-ae5b-44c5dc7d9ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:18.721989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1210/2438] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:18 2022] DELETE /identity/v3/projects/0c0d9bbef73e4de9a9c76eec3c375cf6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:18.727570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] MFA Rules not processed for user `da4fdef99b25452aabcd93cd3a7f6dfb`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:18.728100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612498-4079-44a6-8b48-c55404f999ca None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.728100 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612498-4079-44a6-8b48-c55404f999ca None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.728288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c612498-4079-44a6-8b48-c55404f999ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.729028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.750429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6c612498-4079-44a6-8b48-c55404f999ca None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:18.751714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6c612498-4079-44a6-8b48-c55404f999ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.785073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:18.810457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1229/2439] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:18.815007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.816588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.821975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1211/2440] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:18.829580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.829873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.830669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.831802 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f39ea-67e0-4b25-8438-0f2e387b7ec8 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.836636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.837329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.837692 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.838058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.838808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.841151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.851507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:18.852727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.862503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1212/2441] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:18.867091 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.871174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1230/2442] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:18.875065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.883136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07879fb2-6a7d-47ec-8138-fef7ee176e1e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.941561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b7d59-f4ce-4e70-a26e-fcffe01eda08 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.946114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.946797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.947124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.947391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.948027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.949947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.954153 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.954837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.955121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.955397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.956097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:18.956409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.958039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.971684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1213/2443] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:53:18.975810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.977531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:18.979749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1231/2444] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:18.981041 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:18.990609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7db78f-1771-42c2-aa8a-df493ca0fa9f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.993313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a72e0a-5174-487c-868b-2629d94da9b2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:18.995199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.995835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.996112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.996387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] PATH_INFO: `/v3/projects/e453f77090834404b57d7f404450c720` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:18.997500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e453f77090834404b57d7f404450c720)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:18.998249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:18.999270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:18.999270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:18.999482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:18.999591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.000171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.002428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.033666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1232/2445] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:18 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:19.034413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.047208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e453f77090834404b57d7f404450c720', 'request_id': 'req-eedff293-9999-42f2-ac08-85c74b1ef5ab'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:19.049704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:19.054511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e453f77090834404b57d7f404450c720', 'request_id': 'req-eedff293-9999-42f2-ac08-85c74b1ef5ab'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:19.062998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e453f77090834404b57d7f404450c720', 'request_id': 'req-eedff293-9999-42f2-ac08-85c74b1ef5ab'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:19.077132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] The token cache is being invalidate because project e453f77090834404b57d7f404450c720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:19.077416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:19.078151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:19.079689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1214/2446] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:18 2022] DELETE /identity/v3/projects/e453f77090834404b57d7f404450c720 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:19.080427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.081745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.102627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489b97d-709b-4530-8252-8aa975bcad0c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.135814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:19.147473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff293-9999-42f2-ac08-85c74b1ef5ab admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.152410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.153001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.153289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.153571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.154198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.157955 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.159778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57476b5-4d0b-4af8-ba5e-f4fe5a309f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.160397 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57476b5-4d0b-4af8-ba5e-f4fe5a309f26 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.160676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57476b5-4d0b-4af8-ba5e-f4fe5a309f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.160947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57476b5-4d0b-4af8-ba5e-f4fe5a309f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.161630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57476b5-4d0b-4af8-ba5e-f4fe5a309f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.163262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57476b5-4d0b-4af8-ba5e-f4fe5a309f26 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.174379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1233/2447] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:19.175800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.176077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.176342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.179372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1215/2448] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:19.180167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.183432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.196174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1df33-a244-4033-a32f-016566a539b5 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.197640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:19.198874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.201239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65676bb-b754-40e3-b81d-4cf68a670fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.201906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65676bb-b754-40e3-b81d-4cf68a670fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.202179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65676bb-b754-40e3-b81d-4cf68a670fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.202447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65676bb-b754-40e3-b81d-4cf68a670fdf admin admin] PATH_INFO: `/v3/projects/6b39eef3b4c5473fb86339e752335a2f/users/e73b4b54d5e54bc7b554ed57cf3a1512/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.206740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1234/2449] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:19.207504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.217554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65676bb-b754-40e3-b81d-4cf68a670fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b39eef3b4c5473fb86339e752335a2f, user_id=e73b4b54d5e54bc7b554ed57cf3a1512, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.217821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ad3ca-b087-4970-9b47-8358208d0f67 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.220434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65676bb-b754-40e3-b81d-4cf68a670fdf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.222497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.223111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.223394 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.223688 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.224327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.226630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.234970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1216/2450] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:19 2022] PUT /identity/v3/projects/6b39eef3b4c5473fb86339e752335a2f/users/e73b4b54d5e54bc7b554ed57cf3a1512/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:19.236379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.236661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.236929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.237383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1235/2451] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:19.238910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.249811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8bd1f-8427-4617-99a9-941bd952d8f2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.256590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:19.257785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.308049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.308654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.308933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.309203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.309846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.311485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.319538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1217/2452] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:19.320379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.324428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1236/2453] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:19.324428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.330534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72348d1d-ba57-47c7-a5d0-eb2eea80c583 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.333068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b1c2-60eb-45b2-ae17-09beaeac398a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.335437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.336101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.336379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.336653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.337333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.337723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.338304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.338575 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.338876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.338975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.339505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:19.339803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.341372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.348952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1218/2454] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:19.349731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.354903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1237/2455] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:19.355839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.359596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5916b753-5515-4d3a-8873-945f187aeb50 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.364394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.365040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.365319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.365594 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] PATH_INFO: `/v3/projects/6b39eef3b4c5473fb86339e752335a2f/users/e73b4b54d5e54bc7b554ed57cf3a1512/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.365852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25fd66-6931-4c4c-b654-7e10392f8e3b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.367703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b39eef3b4c5473fb86339e752335a2f, user_id=e73b4b54d5e54bc7b554ed57cf3a1512, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.370363 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.370483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176865e1-3b17-4cb8-a210-8e818795c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.371038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176865e1-3b17-4cb8-a210-8e818795c492 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.371313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176865e1-3b17-4cb8-a210-8e818795c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.371585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176865e1-3b17-4cb8-a210-8e818795c492 admin admin] PATH_INFO: `/v3/projects/b40be0dd380a43e6b91f15dc1f1ee6d6/users/75eb365788c1489aa6119a3e21fd1c7d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.382077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1219/2456] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:19 2022] PUT /identity/v3/projects/6b39eef3b4c5473fb86339e752335a2f/users/e73b4b54d5e54bc7b554ed57cf3a1512/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:19.382870 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.388933 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176865e1-3b17-4cb8-a210-8e818795c492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40be0dd380a43e6b91f15dc1f1ee6d6, user_id=75eb365788c1489aa6119a3e21fd1c7d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.392787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176865e1-3b17-4cb8-a210-8e818795c492 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.395822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:19.409462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1238/2457] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:19 2022] PUT /identity/v3/projects/b40be0dd380a43e6b91f15dc1f1ee6d6/users/75eb365788c1489aa6119a3e21fd1c7d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:19.410931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ef11c-5ef9-4df9-9151-faa9d754ca81 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.411217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ef11c-5ef9-4df9-9151-faa9d754ca81 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.411488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ef11c-5ef9-4df9-9151-faa9d754ca81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.440065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-529ef11c-5ef9-4df9-9151-faa9d754ca81 None None] MFA Rules not processed for user `e73b4b54d5e54bc7b554ed57cf3a1512`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:19.441272 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-529ef11c-5ef9-4df9-9151-faa9d754ca81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.450595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07169b-d1f0-49a0-9112-958609a51aa6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.505938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:19.506767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.507542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.507983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.507983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.508901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.509661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1239/2458] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:19.514577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.514793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.514793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.514793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.531928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:19.533222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.539863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1220/2459] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:19.541112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1240/2460] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:19.546186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.546274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.548055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.557778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf475e-8883-4820-89be-c08bcf33c1c3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.611727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef6a73-adfc-4041-90c4-2e604267e31e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.614106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.614756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.615038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.615312 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.615449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.615932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.616068 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.616212 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.616482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.617848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.639838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1241/2461] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:19.640689 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.642239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.677564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:19.680406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.682120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.693112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1221/2462] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:19.694131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.699483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a606049-501a-4543-90df-5a475b9ef213 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.703074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.703685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.703850 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4318e-a81f-4d74-a083-78b8efa86b13 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.703962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.704225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.709007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.709761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.710175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.710660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.711593 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.713390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.714105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.715784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.728998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1222/2464] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:19.729130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1242/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:19.730006 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.740336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57474b20-43bf-4c27-925a-ab5ab1cd63cf admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.745308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.746082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.746376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.746703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.747886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.749773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.761296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1223/2465] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:19.765626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.776574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2163-bd5d-4f72-b410-3b598831ecfa service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.785985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ee6df-f029-4a91-a608-e38572b50359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.786914 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ee6df-f029-4a91-a608-e38572b50359 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.787291 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ee6df-f029-4a91-a608-e38572b50359 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.787662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ee6df-f029-4a91-a608-e38572b50359 admin admin] PATH_INFO: `/v3/projects/42646b7c2760408486e0ca8143d1be96/users/9064c0cb1bb549b9945d88a129341ea0/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.791980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.803168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896939-11e0-48fb-ad32-8574b23bdba9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:19.806118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ee6df-f029-4a91-a608-e38572b50359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42646b7c2760408486e0ca8143d1be96, user_id=9064c0cb1bb549b9945d88a129341ea0, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.807334 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:19.807938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.808590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.808590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.809668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ee6df-f029-4a91-a608-e38572b50359 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.810600 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.829099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1243/2466] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:19 2022] PUT /identity/v3/projects/42646b7c2760408486e0ca8143d1be96/users/9064c0cb1bb549b9945d88a129341ea0/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:19.840199 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:19.840512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:19.840788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:19.872421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] MFA Rules not processed for user `9064c0cb1bb549b9945d88a129341ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:19.873565 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:19.885829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:19.887436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:19.897613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1224/2467] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:19 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:19.943420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:19.965034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1244/2468] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:19.969834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:19.988208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e040-1af8-48c4-bf24-34332517224f service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.063490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.064764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.066903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.067353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.068008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.070872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.102731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1225/2469] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:19 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:20.108185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.119716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0df8a-8464-4d06-b541-12c7010a303d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.189480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.190535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.191012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.191454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.192233 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.194884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.220284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1245/2470] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:20 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:20.221546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.233441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a847db2-a53b-41b1-9e4b-a33274830032 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.238450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.239088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.239362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.239657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.240295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.242184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.253690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1226/2471] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:20.257725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.268402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bf6f0-c27d-474c-b17b-26c4fd5d62ce admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.274181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.274968 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.275241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.275566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] PATH_INFO: `/v3/projects/44121a683a894bac9bf59e5da2d7f3d3/users/7a0f134b790d4ca0b929b6559e3a88f3/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.291440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44121a683a894bac9bf59e5da2d7f3d3, user_id=7a0f134b790d4ca0b929b6559e3a88f3, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.294208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.308536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1246/2472] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:20 2022] PUT /identity/v3/projects/44121a683a894bac9bf59e5da2d7f3d3/users/7a0f134b790d4ca0b929b6559e3a88f3/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:20.312355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.322777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016c80a-b2cf-4a35-b145-751ef0a8ce62 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.371556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:20.393048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a3866-3082-427e-95f6-3f06a6f4717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.393854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3866-3082-427e-95f6-3f06a6f4717e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.394040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3866-3082-427e-95f6-3f06a6f4717e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.394621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a3866-3082-427e-95f6-3f06a6f4717e admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.395084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a3866-3082-427e-95f6-3f06a6f4717e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.397291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a3866-3082-427e-95f6-3f06a6f4717e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.410880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1227/2473] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:20.412934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.432454 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ffa70-0b9a-42cb-ac88-019c0fe8bac9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.439791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fe40f-dd6a-40a8-98e1-66acb69b4fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.440491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe40f-dd6a-40a8-98e1-66acb69b4fd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.441594 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe40f-dd6a-40a8-98e1-66acb69b4fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.441916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fe40f-dd6a-40a8-98e1-66acb69b4fd9 admin admin] PATH_INFO: `/v3/projects/44121a683a894bac9bf59e5da2d7f3d3/users/7a0f134b790d4ca0b929b6559e3a88f3/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.444712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fe40f-dd6a-40a8-98e1-66acb69b4fd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44121a683a894bac9bf59e5da2d7f3d3, user_id=7a0f134b790d4ca0b929b6559e3a88f3, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.449236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fe40f-dd6a-40a8-98e1-66acb69b4fd9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.465222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1247/2474] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:20 2022] PUT /identity/v3/projects/44121a683a894bac9bf59e5da2d7f3d3/users/7a0f134b790d4ca0b929b6559e3a88f3/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:20.471401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.471683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.471954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.477213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.477479 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.477755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.506304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] MFA Rules not processed for user `7a0f134b790d4ca0b929b6559e3a88f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:20.507583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:20.509598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] MFA Rules not processed for user `75eb365788c1489aa6119a3e21fd1c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:20.510968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:20.597234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1228/2475] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:20.608785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.617311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1248/2476] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:20.634360 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.636646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:20.666118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca73614-ff42-4e66-b5bb-ed689905c4c0 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.670572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.671386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.671692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.671969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.673163 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:20.682126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.683591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.692830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1229/2477] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:20.700078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786e103-7887-43ef-830f-9fd2aaad8ce3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.703893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602eb55-ee48-45c3-94d0-60097468103a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.704495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602eb55-ee48-45c3-94d0-60097468103a service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.704788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602eb55-ee48-45c3-94d0-60097468103a service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.705049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602eb55-ee48-45c3-94d0-60097468103a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.715927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602eb55-ee48-45c3-94d0-60097468103a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.717538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602eb55-ee48-45c3-94d0-60097468103a service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.727364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1249/2478] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:20.779831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:20.788374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca349d-6111-4372-af56-64ef28c6caf2 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:20.792000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:20.792597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:20.792872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:20.793137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:20.851933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:20.853503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:20.863859 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1230/2479] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:22.071315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca687-3626-4444-88ae-9a8ddfd8223e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:22.071874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca687-3626-4444-88ae-9a8ddfd8223e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:22.071874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ca687-3626-4444-88ae-9a8ddfd8223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:22.094896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a61ca687-3626-4444-88ae-9a8ddfd8223e None None] MFA Rules not processed for user `75eb365788c1489aa6119a3e21fd1c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:22.096100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a61ca687-3626-4444-88ae-9a8ddfd8223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:22.105800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1250/2480] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:24.376855 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:24.392152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:24.442466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109e4c3-f520-4130-a62d-a80cc758f0f6 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:24.448147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:24.448813 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:24.449090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:24.449478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] PATH_INFO: `/v3/users/9064c0cb1bb549b9945d88a129341ea0` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:24.450529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9064c0cb1bb549b9945d88a129341ea0)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:24.452534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:24.505626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9064c0cb1bb549b9945d88a129341ea0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:24.513529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9064c0cb1bb549b9945d88a129341ea0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:24.521874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9064c0cb1bb549b9945d88a129341ea0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:24.522575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9064c0cb1bb549b9945d88a129341ea0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:24.539295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9064c0cb1bb549b9945d88a129341ea0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:24.546136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1231/2481] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:24 2022] DELETE /identity/v3/users/9064c0cb1bb549b9945d88a129341ea0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:24.551745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:24.552231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:24.552446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:24.575167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:24.576392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:24.645752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1251/2482] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:24.659603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:24.661487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:24.720800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2c7c1-f04e-419f-ae55-834ce6216e4e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:24.724529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:24.725142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:24.725418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:24.725690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:24.735043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:24.736475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:24.746373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1232/2483] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:25.054520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:25.056299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:25.071262 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc234aaa-963f-4861-a485-8073a7d8f6c4 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:25.079436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:25.080083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:25.080379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:25.080619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] PATH_INFO: `/v3/projects/42646b7c2760408486e0ca8143d1be96` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:25.081739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42646b7c2760408486e0ca8143d1be96)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:25.083687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:25.151794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42646b7c2760408486e0ca8143d1be96', 'request_id': 'req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.161292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42646b7c2760408486e0ca8143d1be96', 'request_id': 'req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.168355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42646b7c2760408486e0ca8143d1be96', 'request_id': 'req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.209073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] The token cache is being invalidate because project 42646b7c2760408486e0ca8143d1be96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:25.209073 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.210275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.215736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1252/2484] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:25 2022] DELETE /identity/v3/projects/42646b7c2760408486e0ca8143d1be96 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:25.216991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:25.228602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c480c21-453f-4f5a-8522-bf7625d1eeb4 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:25.267150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:25.294409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:25.295301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:25.295703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:25.295978 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] PATH_INFO: `/v3/users/7a0f134b790d4ca0b929b6559e3a88f3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:25.297143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0f134b790d4ca0b929b6559e3a88f3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:25.299109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:25.349648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0f134b790d4ca0b929b6559e3a88f3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.357652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0f134b790d4ca0b929b6559e3a88f3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.372763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0f134b790d4ca0b929b6559e3a88f3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.373478 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0f134b790d4ca0b929b6559e3a88f3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.389313 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-825e236a-e02f-4280-a800-c84260e49c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0f134b790d4ca0b929b6559e3a88f3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.399202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1233/2485] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:25 2022] DELETE /identity/v3/users/7a0f134b790d4ca0b929b6559e3a88f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:25.772706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:25.774218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:25.788846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07c47d-9c82-4d04-95d2-c3f2a8a6f7a2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:25.834083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:25.847039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:25.847666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:25.847939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:25.848207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] PATH_INFO: `/v3/projects/44121a683a894bac9bf59e5da2d7f3d3` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:25.849347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44121a683a894bac9bf59e5da2d7f3d3)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:25.851295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:25.906288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44121a683a894bac9bf59e5da2d7f3d3', 'request_id': 'req-2e6ebaa7-805c-4796-830a-de131323ade5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.911916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44121a683a894bac9bf59e5da2d7f3d3', 'request_id': 'req-2e6ebaa7-805c-4796-830a-de131323ade5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.917962 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44121a683a894bac9bf59e5da2d7f3d3', 'request_id': 'req-2e6ebaa7-805c-4796-830a-de131323ade5'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.931540 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] The token cache is being invalidate because project 44121a683a894bac9bf59e5da2d7f3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:25.931838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.932463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2e6ebaa7-805c-4796-830a-de131323ade5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:25.933970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1253/2486] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:25 2022] DELETE /identity/v3/projects/44121a683a894bac9bf59e5da2d7f3d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:25.939173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:25.939463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:25.939733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:25.961937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:25.964400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:26.029848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1234/2487] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:26.038100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.038384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.038656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.058704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:26.059893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:26.068282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1254/2488] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:26.072588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.082599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5deb43-2f81-4331-8256-be6946d97e30 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.087657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.088181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.088450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.088713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.089355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:26.089649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.091264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.102920 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1235/2489] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:26.107184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.116924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f69a68-a314-442e-bc58-442af2c56321 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.121960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.122552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.122878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.123152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.123772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.125760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.154941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1255/2490] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:26 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:26.159239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.169946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344a0c3-1d8d-4359-830f-d1fe5e87e5a0 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.212403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:26.233291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.234210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.234556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.234868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.235683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.237710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.261218 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1236/2491] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:26 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:26.266530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.277441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2228521-c401-448b-b62b-5276ecbe2661 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.286375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.287177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.287541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.287880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.288600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.290420 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.302918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1256/2492] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:26.307435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.318822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba7ffb-3c2d-4ef9-bc3d-72fb1d9cffae admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.324513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308826a6-8c80-48d3-b688-d3411b870bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.325241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308826a6-8c80-48d3-b688-d3411b870bac admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.325592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308826a6-8c80-48d3-b688-d3411b870bac admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.325927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308826a6-8c80-48d3-b688-d3411b870bac admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.326671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308826a6-8c80-48d3-b688-d3411b870bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.328369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308826a6-8c80-48d3-b688-d3411b870bac admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.340463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1237/2493] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:26.344993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.355702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e167b-9cd8-4bcf-b214-ed79cf78f8af admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.360751 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.361410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.361862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.362135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] PATH_INFO: `/v3/projects/caa19185385845b7a79cfad7f2935f8f/users/db8a6c28f100454aa16e750e9a2352e4/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.377173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa19185385845b7a79cfad7f2935f8f, user_id=db8a6c28f100454aa16e750e9a2352e4, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.379891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.393960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1257/2494] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:26 2022] PUT /identity/v3/projects/caa19185385845b7a79cfad7f2935f8f/users/db8a6c28f100454aa16e750e9a2352e4/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:26.404560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.405040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.405134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.432427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] MFA Rules not processed for user `db8a6c28f100454aa16e750e9a2352e4`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:26.433613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:26.499378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1238/2495] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:26.504275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.572384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86697c9b-19f8-41dc-aaf5-d08ca03fb641 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.577209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.577820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.578147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.578415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.579074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.580990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.606227 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:26.617416 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1258/2496] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:26 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:26.622486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.634601 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3496e-248b-4cca-af38-e69aaed47371 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.698786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.699477 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.699822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.700157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.700868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.703279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.730518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1239/2497] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:26 2022] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:26.734673 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.745817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0294f76-3363-4aac-89e7-7d17b83d0982 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.753217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.754045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.754419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.754819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.755706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.757516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.770074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1259/2498] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:26.774425 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.789924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6139-9a3f-4412-9426-2a7de1730d0c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.794771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.795691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.796150 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.796481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] PATH_INFO: `/v3/projects/4ef804978f7c4f668aaa07af86ed8762/users/59733d8897c4471b9e56c50cfdcbfb89/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.813013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef804978f7c4f668aaa07af86ed8762, user_id=59733d8897c4471b9e56c50cfdcbfb89, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.816165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.830979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1240/2499] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:26 2022] PUT /identity/v3/projects/4ef804978f7c4f668aaa07af86ed8762/users/59733d8897c4471b9e56c50cfdcbfb89/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:26.834866 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.855561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72b70b-9fef-4ab1-832f-dfacace66a58 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.925359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b7fe1-1d06-4833-b66c-fba30e7d158e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.925742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b7fe1-1d06-4833-b66c-fba30e7d158e admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.926055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b7fe1-1d06-4833-b66c-fba30e7d158e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.926334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b7fe1-1d06-4833-b66c-fba30e7d158e admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.927481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b7fe1-1d06-4833-b66c-fba30e7d158e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.929341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b7fe1-1d06-4833-b66c-fba30e7d158e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.940535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1260/2500] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:26.945401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:26.956273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cbdf8-b04d-4d43-b181-e7b5406eb6ae admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:26.961098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:26.961814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:26.962086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:26.962356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] PATH_INFO: `/v3/projects/4ef804978f7c4f668aaa07af86ed8762/users/59733d8897c4471b9e56c50cfdcbfb89/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:26.976205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ef804978f7c4f668aaa07af86ed8762, user_id=59733d8897c4471b9e56c50cfdcbfb89, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:26.978982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:26.997480 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1241/2501] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:26 2022] PUT /identity/v3/projects/4ef804978f7c4f668aaa07af86ed8762/users/59733d8897c4471b9e56c50cfdcbfb89/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:27.009559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:27.010558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:27.011220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:27.042412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] MFA Rules not processed for user `59733d8897c4471b9e56c50cfdcbfb89`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:27.043781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:27.114810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1261/2502] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:27.127043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:27.129283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:27.137120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:27.193700 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d3738-ae3a-417f-8b61-cf1805ea9dcd admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:27.197382 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:27.197983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:27.198258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:27.198526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:27.207784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:27.209228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:27.219437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1242/2503] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:27.311885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:27.321949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809b866-c07f-402d-bf00-5e6d2bd06551 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:27.325493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284d317-7e94-4c52-a815-1896cd3d6a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:27.326099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d317-7e94-4c52-a815-1896cd3d6a8d service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:27.326371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d317-7e94-4c52-a815-1896cd3d6a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:27.326646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284d317-7e94-4c52-a815-1896cd3d6a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:27.387856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d317-7e94-4c52-a815-1896cd3d6a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:27.389328 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284d317-7e94-4c52-a815-1896cd3d6a8d service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:27.401024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1262/2504] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:27.682673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:27.750796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a11b5-09ea-45c8-8478-63fab4476c4b service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:27.755971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:27.756644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:27.756919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:27.757216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] PATH_INFO: `/v3/users/db8a6c28f100454aa16e750e9a2352e4` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:27.758434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8a6c28f100454aa16e750e9a2352e4)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:27.760419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:27.812847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8a6c28f100454aa16e750e9a2352e4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:27.823515 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8a6c28f100454aa16e750e9a2352e4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:27.832631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8a6c28f100454aa16e750e9a2352e4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:27.833354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8a6c28f100454aa16e750e9a2352e4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:27.845987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8a6c28f100454aa16e750e9a2352e4'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:27.852049 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1243/2505] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:27 2022] DELETE /identity/v3/users/db8a6c28f100454aa16e750e9a2352e4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:27.856664 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:27.857134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:27.857242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:27.877083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:27.878317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:27.882749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:27.941970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1263/2506] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:27.952043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:27.953637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:27.983812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:28.019890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28df31-a8f9-4f9a-a1c0-c60e407e181c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:28.024422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:28.025045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:28.025318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:28.025583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:28.035624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:28.037213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:28.047250 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1244/2507] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:28.321596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:28.323226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:28.346646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ede8ff-c2f0-4873-9333-0a67490a197d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:28.357937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:28.358722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:28.359149 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:28.359572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] PATH_INFO: `/v3/projects/caa19185385845b7a79cfad7f2935f8f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:28.360921 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa19185385845b7a79cfad7f2935f8f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:28.363841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:28.431923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa19185385845b7a79cfad7f2935f8f', 'request_id': 'req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.437880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa19185385845b7a79cfad7f2935f8f', 'request_id': 'req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.444676 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa19185385845b7a79cfad7f2935f8f', 'request_id': 'req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.457846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] The token cache is being invalidate because project caa19185385845b7a79cfad7f2935f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:28.458186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.458886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.460486 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1264/2508] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:28 2022] DELETE /identity/v3/projects/caa19185385845b7a79cfad7f2935f8f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:28.464624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:28.474399 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437dc79-7cf7-409b-b99a-54aa9d1c87ba service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:28.531261 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:28.531917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:28.532194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:28.532458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] PATH_INFO: `/v3/users/59733d8897c4471b9e56c50cfdcbfb89` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:28.533656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59733d8897c4471b9e56c50cfdcbfb89)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:28.535644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:28.587475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59733d8897c4471b9e56c50cfdcbfb89'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.595778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59733d8897c4471b9e56c50cfdcbfb89'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.605295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59733d8897c4471b9e56c50cfdcbfb89'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.605496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59733d8897c4471b9e56c50cfdcbfb89'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.618000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bad994c8-8c07-4d40-a333-eebe5ac061c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59733d8897c4471b9e56c50cfdcbfb89'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:28.623966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1245/2509] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:28 2022] DELETE /identity/v3/users/59733d8897c4471b9e56c50cfdcbfb89 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:28.911317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:28.913106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:28.929547 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1e8dc-8ff9-4899-9cca-2c0dc6e12c23 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:28.996098 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:28.996896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:28.997174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:28.997438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] PATH_INFO: `/v3/projects/4ef804978f7c4f668aaa07af86ed8762` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:28.998589 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ef804978f7c4f668aaa07af86ed8762)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.000654 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.041871 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:29.054517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ef804978f7c4f668aaa07af86ed8762', 'request_id': 'req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:29.062801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ef804978f7c4f668aaa07af86ed8762', 'request_id': 'req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:29.069225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ef804978f7c4f668aaa07af86ed8762', 'request_id': 'req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:29.082891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] The token cache is being invalidate because project 4ef804978f7c4f668aaa07af86ed8762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:29.083182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:29.083922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-48ad4cc1-e1ef-4e79-b527-32c4dec9b91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:29.085488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1265/2510] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:28 2022] DELETE /identity/v3/projects/4ef804978f7c4f668aaa07af86ed8762 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:29.090656 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.091177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.091285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.111794 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:29.113003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:29.157465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:29.177676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1246/2511] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:29.185690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.185977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.186251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.208392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:29.209619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:29.219085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1266/2512] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:29.223254 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.235419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff6799-4032-41cd-a17c-cce12e2d3728 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.240589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.241264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.241543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.241894 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.242484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:29.242837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.244429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.256906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1247/2513] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:53:29.260698 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.270252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db268fe-8a13-4980-86d0-587590a8706f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.275247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.275842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.276111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.276376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.276989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.278906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.308720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1267/2514] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:29.313054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.322434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.323725 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907af66-f4dc-43b2-9292-19eaed804061 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.324947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:29.388704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.389390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.389671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.389942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.390708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.392654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.416731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1248/2515] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:29.416927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9c226-cee5-4194-a48d-a7446af1b749 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.417951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.420316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.420924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.421226 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.421492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.423386 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:29.427769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a3e3b-3ce4-441e-b1ac-aaab5b68053b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.432517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.433142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.433427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.433710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.434373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.435878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.436076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.437467 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.451101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1249/2516] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:29.451291 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1268/2517] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:29.452225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.463347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78a9c-5c10-4c5c-94ca-1cb27c8eba08 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.468589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba2214-c295-474d-b210-24340bcb66cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.469763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2214-c295-474d-b210-24340bcb66cb admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.469763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2214-c295-474d-b210-24340bcb66cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.469763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2214-c295-474d-b210-24340bcb66cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.470342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba2214-c295-474d-b210-24340bcb66cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.471965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba2214-c295-474d-b210-24340bcb66cb admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.487739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1250/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:29.489124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.500237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e08d0-f4c6-4b28-b62c-9e83c5a5cdc7 service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.505292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.505975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.506252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.506521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] PATH_INFO: `/v3/projects/5922b796630e454b8ff00dd6a9abb37d/users/c41fe8fbb43a4d219002a0a88be37ecd/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.522920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5922b796630e454b8ff00dd6a9abb37d, user_id=c41fe8fbb43a4d219002a0a88be37ecd, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.526061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.542403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1269/2519] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:29 2022] PUT /identity/v3/projects/5922b796630e454b8ff00dd6a9abb37d/users/c41fe8fbb43a4d219002a0a88be37ecd/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:29.553632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.553982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.554317 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.586008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] MFA Rules not processed for user `c41fe8fbb43a4d219002a0a88be37ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:29.587374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:29.660002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1251/2520] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:29.664876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.734072 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:29.740779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a669c-2c68-48d0-ac38-0d2c4c388aeb admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.748816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.749457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.750032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.750669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.751382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.756868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.790556 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1270/2521] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:29.794940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.808184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6694f-44fe-4c5b-99ff-1b7abff98354 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.844692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:29.887632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.888657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.888936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.894938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.894938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.894938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.922720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1252/2522] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:29 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:29.924746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.935234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd60c2-bbcf-4099-937b-c4d26ccc299d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.940903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.940903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.941146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.941424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.942047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.943700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:29.955480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1271/2523] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:29.959677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:29.970318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963e69-af0f-452d-bfa8-5f50220445f6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:29.975151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:29.975812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:29.976084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:29.976355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] PATH_INFO: `/v3/projects/5a3965d31d0f4e56a27c8ce587a72283/users/9db456c97dd74d13a596d86f17a65907/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:29.992676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3965d31d0f4e56a27c8ce587a72283, user_id=9db456c97dd74d13a596d86f17a65907, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:29.995534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:30.008596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1253/2524] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:29 2022] PUT /identity/v3/projects/5a3965d31d0f4e56a27c8ce587a72283/users/9db456c97dd74d13a596d86f17a65907/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:30.012764 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:30.023590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ea832-cbb6-4d81-b467-1c633b92cb60 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:30.080380 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ddd38f-4fbf-432c-a347-45d3fb53992f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:30.080975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd38f-4fbf-432c-a347-45d3fb53992f admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:30.081253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd38f-4fbf-432c-a347-45d3fb53992f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:30.081513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ddd38f-4fbf-432c-a347-45d3fb53992f admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:30.082126 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddd38f-4fbf-432c-a347-45d3fb53992f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:30.083748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ddd38f-4fbf-432c-a347-45d3fb53992f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:30.093460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1272/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:30.097942 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:30.108685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e2a9c-2a71-492a-8f11-2b9264590ee9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:30.113572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:30.114227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:30.114507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:30.114815 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] PATH_INFO: `/v3/projects/5a3965d31d0f4e56a27c8ce587a72283/users/9db456c97dd74d13a596d86f17a65907/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:30.116791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3965d31d0f4e56a27c8ce587a72283, user_id=9db456c97dd74d13a596d86f17a65907, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:30.119525 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:30.130236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1254/2526] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:30 2022] PUT /identity/v3/projects/5a3965d31d0f4e56a27c8ce587a72283/users/9db456c97dd74d13a596d86f17a65907/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:30.141613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:30.141897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:30.142161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:30.170781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] MFA Rules not processed for user `9db456c97dd74d13a596d86f17a65907`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:30.172083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:30.243496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1273/2527] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:30.257682 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:30.260629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:30.322848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e131-faa7-4422-b273-472d5258e12d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:30.327294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:30.327995 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:30.328472 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:30.328939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:30.399661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:30.401144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:30.410500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1255/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:34.718782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:34.720745 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:34.736412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64f56e-4620-41d8-9114-4b2f2e86fd6c None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:34.740023 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5455241-4681-491e-930b-2bc5f0176f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:34.740626 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455241-4681-491e-930b-2bc5f0176f3f service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:34.740909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455241-4681-491e-930b-2bc5f0176f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:34.741176 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455241-4681-491e-930b-2bc5f0176f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:34.750717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455241-4681-491e-930b-2bc5f0176f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:34.752294 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455241-4681-491e-930b-2bc5f0176f3f service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:34.762828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1274/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:35.333852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:35.335420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:35.380071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:35.406950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f74c7-8f2a-4b87-b07f-a2a716b7f02c service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:35.412786 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:35.413430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:35.413731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:35.414004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] PATH_INFO: `/v3/users/da4fdef99b25452aabcd93cd3a7f6dfb` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:35.415293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4fdef99b25452aabcd93cd3a7f6dfb)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:35.417226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:35.466412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4fdef99b25452aabcd93cd3a7f6dfb'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:35.474380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4fdef99b25452aabcd93cd3a7f6dfb'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:35.481369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4fdef99b25452aabcd93cd3a7f6dfb'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:35.482077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4fdef99b25452aabcd93cd3a7f6dfb'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:35.494390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4fdef99b25452aabcd93cd3a7f6dfb'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:35.501195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1256/2530] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:35 2022] DELETE /identity/v3/users/da4fdef99b25452aabcd93cd3a7f6dfb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:35.505809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:35.506101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:35.506390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:35.525918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:35.527175 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:35.561821 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:35.589855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1275/2531] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:35.599661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:35.601082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:35.661371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9ccec-cd01-4c7b-9ccb-4c0fa763a481 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:35.665213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:35.665802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:35.666073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:35.666343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:35.675957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:35.677383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:35.687205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1257/2532] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:36.044853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:36.046774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:36.064491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3fead-c284-40ff-8a52-65ea1e6f16eb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:36.069426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:36.070147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:36.070980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:36.070980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] PATH_INFO: `/v3/projects/7095f33fddc44ab49902976a1f1a5ba0` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:36.072694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7095f33fddc44ab49902976a1f1a5ba0)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:36.074911 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:36.137096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7095f33fddc44ab49902976a1f1a5ba0', 'request_id': 'req-ce5f0b12-0586-4ea6-a045-03de84ae7c76'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.142609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7095f33fddc44ab49902976a1f1a5ba0', 'request_id': 'req-ce5f0b12-0586-4ea6-a045-03de84ae7c76'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.149975 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7095f33fddc44ab49902976a1f1a5ba0', 'request_id': 'req-ce5f0b12-0586-4ea6-a045-03de84ae7c76'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.163880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] The token cache is being invalidate because project 7095f33fddc44ab49902976a1f1a5ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:36.165842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.166578 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.168941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1276/2533] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:36 2022] DELETE /identity/v3/projects/7095f33fddc44ab49902976a1f1a5ba0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:36.173055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:36.185717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668326-e44b-4c12-b205-81e7a9df8a6c service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:36.326415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:36.327406 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:36.329987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:36.329987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] PATH_INFO: `/v3/users/e73b4b54d5e54bc7b554ed57cf3a1512` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:36.329987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73b4b54d5e54bc7b554ed57cf3a1512)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:36.332044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:36.334479 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:36.404557 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73b4b54d5e54bc7b554ed57cf3a1512'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.414635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73b4b54d5e54bc7b554ed57cf3a1512'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.429014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73b4b54d5e54bc7b554ed57cf3a1512'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.430097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73b4b54d5e54bc7b554ed57cf3a1512'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.457307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-b0a70f6a-20b7-4043-9ab3-c3c5284836e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73b4b54d5e54bc7b554ed57cf3a1512'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.464011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1258/2534] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:36 2022] DELETE /identity/v3/users/e73b4b54d5e54bc7b554ed57cf3a1512 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:36.776915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:36.778516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:36.799485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f0b12-0586-4ea6-a045-03de84ae7c76 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:36.870334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:36.871071 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:36.871359 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:36.871636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] PATH_INFO: `/v3/projects/6b39eef3b4c5473fb86339e752335a2f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:36.872785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b39eef3b4c5473fb86339e752335a2f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:36.874958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:36.928090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b39eef3b4c5473fb86339e752335a2f', 'request_id': 'req-650ead66-ada2-43e1-8211-082a5d069b85'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.934389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b39eef3b4c5473fb86339e752335a2f', 'request_id': 'req-650ead66-ada2-43e1-8211-082a5d069b85'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.941184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b39eef3b4c5473fb86339e752335a2f', 'request_id': 'req-650ead66-ada2-43e1-8211-082a5d069b85'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.942932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:36.956264 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] The token cache is being invalidate because project 6b39eef3b4c5473fb86339e752335a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:36.956776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.957414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-650ead66-ada2-43e1-8211-082a5d069b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:36.960327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1277/2535] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:36 2022] DELETE /identity/v3/projects/6b39eef3b4c5473fb86339e752335a2f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:36.965458 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426468f-d33b-4625-995f-4e53622a261c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:36.966709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426468f-d33b-4625-995f-4e53622a261c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:36.966987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426468f-d33b-4625-995f-4e53622a261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:36.989356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d426468f-d33b-4625-995f-4e53622a261c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:36.990548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d426468f-d33b-4625-995f-4e53622a261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:37.065431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1259/2536] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:37.073722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.074277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.074277 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.096054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:37.097259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:37.105819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1278/2537] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:37.110442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426468f-d33b-4625-995f-4e53622a261c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.121670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426468f-d33b-4625-995f-4e53622a261c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.127064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.127684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.127962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.128246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.128893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:37.129190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.130842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.142875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1260/2538] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:37.147755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.157271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8d248-7d9e-4088-aa82-074bac2e6fbb None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.162140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.162760 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.163033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.163296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.163919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.165803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.193356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1279/2539] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:37 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:37.197707 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.208017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3d450-1bed-43d6-95df-1eea0690e21d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.269229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.269893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.270231 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.270359 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.271039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.273294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.284464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:37.298866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1261/2540] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:37 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:37.302714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.313465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549299da-82fa-45ae-8d9f-ca1ae0113f37 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.319659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.320361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.321234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.321234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.321603 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.323559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.340514 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1280/2541] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:37.344837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.355917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722d4ea-8191-4d8f-bcc3-5355c46537b3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.361513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2305fa-d6f5-4c40-8e16-2a375cf75866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.362154 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2305fa-d6f5-4c40-8e16-2a375cf75866 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.362431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2305fa-d6f5-4c40-8e16-2a375cf75866 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.362733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2305fa-d6f5-4c40-8e16-2a375cf75866 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.363413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2305fa-d6f5-4c40-8e16-2a375cf75866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.365084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2305fa-d6f5-4c40-8e16-2a375cf75866 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.377400 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1262/2542] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:37.382405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.398892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c22af-e34a-460a-b582-3c924f5fe11c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.404263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.405007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.405289 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.405561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] PATH_INFO: `/v3/projects/5c51efd3f5614070ad15692a5df4a70b/users/4a7d0fda446049c8a947d5234f647b07/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.422770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c51efd3f5614070ad15692a5df4a70b, user_id=4a7d0fda446049c8a947d5234f647b07, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.425429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.443295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1281/2543] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:37 2022] PUT /identity/v3/projects/5c51efd3f5614070ad15692a5df4a70b/users/4a7d0fda446049c8a947d5234f647b07/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:37.453668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.453953 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.454222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.487356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] MFA Rules not processed for user `4a7d0fda446049c8a947d5234f647b07`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:37.490603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:37.578315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1263/2544] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:37.582942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.657515 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10c5e-5b4d-43fa-bd42-7f7ede2bcb41 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.662863 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.663807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.664279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.664613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.665343 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.667445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.708659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1282/2545] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:37 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:37.710465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.725166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac76d20-5ba3-4390-8979-0bc70189b979 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.796162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.796996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.797338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.797675 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.798371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.800549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.828719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1264/2546] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:37 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:37.830191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.840590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797eba3-ad69-4d67-8e1c-5e64378b7a2e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.845640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.846237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.846510 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.846811 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.847450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.849037 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.860455 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1283/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:37.864665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.877101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce333e-53e5-4c4a-806a-8bbeb3881fee admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:37.883568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:37.884207 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:37.884488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:37.884762 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] PATH_INFO: `/v3/projects/ca4f15a3fa2d4dfaafb99a0013407979/users/15d8b30ce9924a7abc92c51bfa0e9a91/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:37.904632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4f15a3fa2d4dfaafb99a0013407979, user_id=15d8b30ce9924a7abc92c51bfa0e9a91, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:37.907799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:37.922983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1265/2548] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:37 2022] PUT /identity/v3/projects/ca4f15a3fa2d4dfaafb99a0013407979/users/15d8b30ce9924a7abc92c51bfa0e9a91/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:37.927446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:37.939569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea471ce-c130-43df-9e15-027e311a3766 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:38.009316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9133c0-ceec-4390-8f4d-f3de9f019452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:38.010040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9133c0-ceec-4390-8f4d-f3de9f019452 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:38.010396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9133c0-ceec-4390-8f4d-f3de9f019452 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:38.010765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9133c0-ceec-4390-8f4d-f3de9f019452 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:38.011487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9133c0-ceec-4390-8f4d-f3de9f019452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:38.013268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9133c0-ceec-4390-8f4d-f3de9f019452 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:38.016232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:38.030544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1284/2549] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:38.034007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:38.046619 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50620d-1122-4f2a-9fef-a2cbf36899c1 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:38.056365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:38.057053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:38.057336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:38.057749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] PATH_INFO: `/v3/projects/ca4f15a3fa2d4dfaafb99a0013407979/users/15d8b30ce9924a7abc92c51bfa0e9a91/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:38.059823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4f15a3fa2d4dfaafb99a0013407979, user_id=15d8b30ce9924a7abc92c51bfa0e9a91, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:38.063360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:38.077663 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1266/2550] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:38 2022] PUT /identity/v3/projects/ca4f15a3fa2d4dfaafb99a0013407979/users/15d8b30ce9924a7abc92c51bfa0e9a91/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:38.089061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:38.089550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:38.089694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:38.121085 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] MFA Rules not processed for user `15d8b30ce9924a7abc92c51bfa0e9a91`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:38.122357 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:38.204649 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1285/2551] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:38.217103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:38.219197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:38.253446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:38.284084 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a916bc-c1bd-431d-8d87-855ebf756bec admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:38.289910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad90e8d-4659-47fe-8a73-899b0ab5c36d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:38.290509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad90e8d-4659-47fe-8a73-899b0ab5c36d service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:38.290818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad90e8d-4659-47fe-8a73-899b0ab5c36d service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:38.291085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad90e8d-4659-47fe-8a73-899b0ab5c36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:38.352912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad90e8d-4659-47fe-8a73-899b0ab5c36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:38.354442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad90e8d-4659-47fe-8a73-899b0ab5c36d service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:38.367781 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1267/2552] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:39.924421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:39.932912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:40.000196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d61c8c-c4dd-4440-83ef-cba561dc645a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:40.005382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:40.006038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:40.006316 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:40.006590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] PATH_INFO: `/v3/users/c41fe8fbb43a4d219002a0a88be37ecd` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:40.008025 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41fe8fbb43a4d219002a0a88be37ecd)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:40.010130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:40.059982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41fe8fbb43a4d219002a0a88be37ecd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.067241 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41fe8fbb43a4d219002a0a88be37ecd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.075484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41fe8fbb43a4d219002a0a88be37ecd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.076204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41fe8fbb43a4d219002a0a88be37ecd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.088088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41fe8fbb43a4d219002a0a88be37ecd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.094093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1286/2553] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:39 2022] DELETE /identity/v3/users/c41fe8fbb43a4d219002a0a88be37ecd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:40.098971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:40.099486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:40.099599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:40.120683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:40.122063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:40.187531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1268/2554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:40.198283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:40.200068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:40.206321 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:40.277002 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10761172-6f2f-477f-933c-05e555b9d3c7 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:40.281430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:40.282020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:40.282290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:40.282552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:40.292590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:40.294026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:40.304088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1287/2555] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:40.493909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:40.503764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5983c-a423-4bf9-8858-86bd29eb08d0 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:40.507732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:40.508413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:40.508693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:40.508987 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:40.510818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:40.523389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:40.524898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:40.536160 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1269/2556] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:40.595790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:40.597572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:40.619906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd001699-033d-4a69-ab1f-7ef17ca46c4e service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:40.633347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:40.633999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:40.634275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:40.634541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] PATH_INFO: `/v3/projects/5922b796630e454b8ff00dd6a9abb37d` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:40.636396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5922b796630e454b8ff00dd6a9abb37d)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:40.638818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:40.693763 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5922b796630e454b8ff00dd6a9abb37d', 'request_id': 'req-0b661b47-1637-4f38-a82b-ad8a77014e90'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.699727 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5922b796630e454b8ff00dd6a9abb37d', 'request_id': 'req-0b661b47-1637-4f38-a82b-ad8a77014e90'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.706217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5922b796630e454b8ff00dd6a9abb37d', 'request_id': 'req-0b661b47-1637-4f38-a82b-ad8a77014e90'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.720683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] The token cache is being invalidate because project 5922b796630e454b8ff00dd6a9abb37d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:40.721043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.721738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.723601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1288/2557] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:40 2022] DELETE /identity/v3/projects/5922b796630e454b8ff00dd6a9abb37d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:40.727784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:40.738292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00a312-f52e-40b4-97e2-8d97937a5916 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:40.797654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:40.798295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:40.798814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:40.799252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] PATH_INFO: `/v3/users/9db456c97dd74d13a596d86f17a65907` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:40.800433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db456c97dd74d13a596d86f17a65907)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:40.802366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:40.814526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:40.855630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db456c97dd74d13a596d86f17a65907'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.865518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db456c97dd74d13a596d86f17a65907'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.873340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db456c97dd74d13a596d86f17a65907'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.874090 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db456c97dd74d13a596d86f17a65907'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.889928 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db456c97dd74d13a596d86f17a65907'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:40.896097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1270/2558] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:40 2022] DELETE /identity/v3/users/9db456c97dd74d13a596d86f17a65907 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:40.975699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:40.977474 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:41.059528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b661b47-1637-4f38-a82b-ad8a77014e90 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.114298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:41.123690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.124319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.124614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.124909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.128133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:41.213469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.215077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9432b2-24ce-4e41-b35c-96e7272aec5f service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.230773 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1289/2559] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:41.248923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.251094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:41.367008 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628881-4a47-4270-ae38-687ffb08d9db admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.371899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.372598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.372925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.373285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] PATH_INFO: `/v3/projects/5a3965d31d0f4e56a27c8ce587a72283` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.374495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3965d31d0f4e56a27c8ce587a72283)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.376596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.432402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3965d31d0f4e56a27c8ce587a72283', 'request_id': 'req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:41.443671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3965d31d0f4e56a27c8ce587a72283', 'request_id': 'req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:41.452052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3965d31d0f4e56a27c8ce587a72283', 'request_id': 'req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:41.472506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] The token cache is being invalidate because project 5a3965d31d0f4e56a27c8ce587a72283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:41.472804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:41.473453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8ffb1039-cce8-4ecc-b9eb-0d06f8a524c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:41.478733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1271/2560] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:41 2022] DELETE /identity/v3/projects/5a3965d31d0f4e56a27c8ce587a72283 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:41.481410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.481693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.482013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.503781 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:41.505010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:41.581731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1290/2561] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:41.590331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.590581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.590917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.612248 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:41.613704 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:41.622457 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1272/2562] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:41.627130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.652742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31c817-a6ed-4b19-bfb7-bf201ec7604b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.660084 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.661648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.662382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.663038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.663752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:41.664434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.665631 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.682951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1291/2563] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:41.684210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.694393 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0fffd-2bc5-415c-b22b-fb06d1028ead None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.700485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.701307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.701690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.702137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.703719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.705414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.719389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:41.742957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1273/2564] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:41 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:41.746959 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.757179 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafefe4a-4012-4317-8f23-87a88991ec73 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.832351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.832974 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.833259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.833512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.834288 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.837067 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.876550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1292/2565] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:41 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:41.880586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.893383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe169-156e-4051-adbc-bf612d0cf632 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.898967 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.899590 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.900015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.900288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.900945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.902548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.913560 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1274/2566] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:41.919232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.930285 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3108d-4a13-4a14-b2c8-1b9ed48406f0 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.935726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c55d83-1df6-4693-9b40-d224ca6b2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.936546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55d83-1df6-4693-9b40-d224ca6b2f99 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.936829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55d83-1df6-4693-9b40-d224ca6b2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.937101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c55d83-1df6-4693-9b40-d224ca6b2f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.937834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55d83-1df6-4693-9b40-d224ca6b2f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.939599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c55d83-1df6-4693-9b40-d224ca6b2f99 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:41.946369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:41.956779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1293/2567] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:41.960549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:41.971347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432eef6-cbe6-4e5b-a6e7-671b99a8eda2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:41.977824 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:41.978510 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:41.978825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:41.979110 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] PATH_INFO: `/v3/projects/f0ae807b73fa4c839167f48dab6418b9/users/7fc26db246b4487b9cee6d573dae5889/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:41.995969 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ae807b73fa4c839167f48dab6418b9, user_id=7fc26db246b4487b9cee6d573dae5889, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:41.998970 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:42.013467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1275/2568] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:41 2022] PUT /identity/v3/projects/f0ae807b73fa4c839167f48dab6418b9/users/7fc26db246b4487b9cee6d573dae5889/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:42.027194 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:42.027756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:42.027756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:42.057980 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] MFA Rules not processed for user `7fc26db246b4487b9cee6d573dae5889`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:42.059324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:42.131583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1294/2569] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:42.143379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:42.145226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:42.205327 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6723-060e-4955-9eea-b842d5e14be2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:42.209837 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:42.210451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:42.210754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:42.211029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:42.220381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:42.221867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:42.230805 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1276/2570] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:44.016554 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:44.018213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:44.098589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:44.105301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:44.128693 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0497a6c-250e-46fd-948b-a41d638a8e9d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:44.141068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:44.141889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.142169 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.142449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.147509 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:44.167611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:44.169790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:44.192109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1295/2571] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:44.237750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9ec54-6ab6-4e1d-a883-fcd5b4823c2d service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:44.242459 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:44.243156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.243529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.243732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] PATH_INFO: `/v3/users/ee081ad8284348af88afe1a8c3dabc97` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.244914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee081ad8284348af88afe1a8c3dabc97)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:44.246957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:44.322838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee081ad8284348af88afe1a8c3dabc97'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.338338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee081ad8284348af88afe1a8c3dabc97'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.344241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:44.347612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee081ad8284348af88afe1a8c3dabc97'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.350244 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee081ad8284348af88afe1a8c3dabc97'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.365721 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-f67b1d21-0f0e-44df-a04e-e7f97b61bda0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee081ad8284348af88afe1a8c3dabc97'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.373102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1277/2572] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:44 2022] DELETE /identity/v3/users/ee081ad8284348af88afe1a8c3dabc97 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:44.556351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:44.568870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a78ea-60a2-4626-84f9-291b9fc90572 service placement] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:44.627095 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:44.627719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.627992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.628255 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] PATH_INFO: `/v3/projects/c51b4e47810f4efb90378eab161f0ebb` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.629385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51b4e47810f4efb90378eab161f0ebb)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:44.631338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:44.656263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:44.685243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51b4e47810f4efb90378eab161f0ebb', 'request_id': 'req-95cdf593-4410-4132-afc5-37c7fd33a08b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.692266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51b4e47810f4efb90378eab161f0ebb', 'request_id': 'req-95cdf593-4410-4132-afc5-37c7fd33a08b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.699094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51b4e47810f4efb90378eab161f0ebb', 'request_id': 'req-95cdf593-4410-4132-afc5-37c7fd33a08b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.716252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] The token cache is being invalidate because project c51b4e47810f4efb90378eab161f0ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:44.716543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.717161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-95cdf593-4410-4132-afc5-37c7fd33a08b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:44.718876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1296/2573] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:44 2022] DELETE /identity/v3/projects/c51b4e47810f4efb90378eab161f0ebb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:44.724056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.724422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.724793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.749044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:44.750316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:44.829842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1278/2574] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:44.838033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.838318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.838591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.861364 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:44.862585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:44.873891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1297/2575] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:44.877402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:44.887467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0687f-0e6e-4797-91b7-37c755160fae None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:44.892556 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:44.893152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.893426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.893694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.894339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:44.894642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:44.896390 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:44.909193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1279/2576] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:44.913852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:44.923341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c28cd-26b2-4373-a099-281a936c41e9 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:44.928814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:44.929424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:44.929697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:44.929960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:44.930598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:44.932521 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:44.962538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1298/2577] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:44 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:44.967157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:44.977735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54e2b4-16a3-44cf-87f2-ff5ecb9b26f8 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.046868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.047492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.047771 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.048042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.048669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.050580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.080227 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1280/2578] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:44 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:45.081541 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.093872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd769c-d6c1-46ab-81e8-6ae8cc1a1040 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.099513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.100128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.100405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.100672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.101317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.102951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.117324 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1299/2579] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:45.121818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.133202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf176d73-b303-4e35-ab5d-5a130d1466e2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.139340 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62246d5-f27e-412a-9302-ea97e640c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.140028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62246d5-f27e-412a-9302-ea97e640c7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.140419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62246d5-f27e-412a-9302-ea97e640c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.140751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62246d5-f27e-412a-9302-ea97e640c7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.141487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62246d5-f27e-412a-9302-ea97e640c7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.143418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62246d5-f27e-412a-9302-ea97e640c7d5 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.159769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1281/2580] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:45.164047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.174648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515dd67-23e5-4afb-90c0-adf9a5918044 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.181744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.182421 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.182724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.183022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] PATH_INFO: `/v3/projects/c6c4c040012646289a8ac04d938cf6f2/users/19ba42f5c1dc4a84af3d0b0200578d3f/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.198082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c4c040012646289a8ac04d938cf6f2, user_id=19ba42f5c1dc4a84af3d0b0200578d3f, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.200797 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.219481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1300/2581] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:45 2022] PUT /identity/v3/projects/c6c4c040012646289a8ac04d938cf6f2/users/19ba42f5c1dc4a84af3d0b0200578d3f/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:45.230939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.231221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.231517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.261716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] MFA Rules not processed for user `19ba42f5c1dc4a84af3d0b0200578d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:45.262957 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:45.298329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:45.341522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1282/2582] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:45.347423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.429345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298682e-8630-43a8-bed9-98cfc35910dc admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.434305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.435043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.435383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.435713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.436410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.438623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.473617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1301/2583] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:45 2022] POST /identity/v3/projects => generated 403 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:45.478305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.490152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddbea9-a881-4ec7-897e-e19310eda232 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.562474 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.563264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.563736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.564172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.564982 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.567283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.599456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1283/2584] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:45 2022] POST /identity/v3/users => generated 308 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:45.603584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.615074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df62772-b432-4a5c-a772-b7fa0bcd4d9f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.619790 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.620448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.620788 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.620965 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.621606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.623258 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.633979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1302/2585] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:45.638244 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.648963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622e16-6e61-4eab-a262-3c3c0df41ec3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.654325 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.655098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.655371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.655644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] PATH_INFO: `/v3/projects/4939c3eedc13429a9b61ef033bd512dd/users/d3d8239185f94803a5bfc3973486d9ca/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.672598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939c3eedc13429a9b61ef033bd512dd, user_id=d3d8239185f94803a5bfc3973486d9ca, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.675291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.693360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1284/2586] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:45 2022] PUT /identity/v3/projects/4939c3eedc13429a9b61ef033bd512dd/users/d3d8239185f94803a5bfc3973486d9ca/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:45.697400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.707579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4ee4e-f4dd-47eb-9ac9-075f611b6f76 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.727107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:45.770858 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb24299-43fb-4171-b65b-43b15add8a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.771549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb24299-43fb-4171-b65b-43b15add8a95 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.772144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb24299-43fb-4171-b65b-43b15add8a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.772413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb24299-43fb-4171-b65b-43b15add8a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.773061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb24299-43fb-4171-b65b-43b15add8a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.774716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb24299-43fb-4171-b65b-43b15add8a95 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.784484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1303/2587] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:45.789017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.799814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d824e8-2e81-4f62-933e-ace96b84e5b3 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:45.805896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:45.806597 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.806907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.807177 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] PATH_INFO: `/v3/projects/4939c3eedc13429a9b61ef033bd512dd/users/d3d8239185f94803a5bfc3973486d9ca/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.809256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939c3eedc13429a9b61ef033bd512dd, user_id=d3d8239185f94803a5bfc3973486d9ca, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:45.812020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:45.824128 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1285/2588] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:45 2022] PUT /identity/v3/projects/4939c3eedc13429a9b61ef033bd512dd/users/d3d8239185f94803a5bfc3973486d9ca/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:45.835344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:45.835625 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:45.835893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:45.866786 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] MFA Rules not processed for user `d3d8239185f94803a5bfc3973486d9ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:45.867960 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:45.940843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1304/2589] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:45.951829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:45.954101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:46.017071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e237ed-ca33-4c1b-b367-a5516f6118da admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:46.021573 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e88938-8216-47d5-b63c-64135f5f2789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:46.022546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e88938-8216-47d5-b63c-64135f5f2789 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:46.022851 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e88938-8216-47d5-b63c-64135f5f2789 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:46.023120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e88938-8216-47d5-b63c-64135f5f2789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:46.032667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e88938-8216-47d5-b63c-64135f5f2789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:46.034099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e88938-8216-47d5-b63c-64135f5f2789 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:46.043482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1286/2590] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:45 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:46.248417 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:46.313306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7176-a2b4-4798-a708-de4fe45d2c80 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:46.318862 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:46.319489 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:46.319762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:46.320029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] PATH_INFO: `/v3/users/19ba42f5c1dc4a84af3d0b0200578d3f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:46.321225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ba42f5c1dc4a84af3d0b0200578d3f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:46.323164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:46.371426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:46.374588 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ba42f5c1dc4a84af3d0b0200578d3f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:46.382155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ba42f5c1dc4a84af3d0b0200578d3f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:46.389507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ba42f5c1dc4a84af3d0b0200578d3f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:46.390177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ba42f5c1dc4a84af3d0b0200578d3f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:46.402336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ba42f5c1dc4a84af3d0b0200578d3f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:46.408078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1305/2591] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:46 2022] DELETE /identity/v3/users/19ba42f5c1dc4a84af3d0b0200578d3f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:46.412809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:46.413311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:46.413311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:46.432800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:46.434022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:46.454264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:46.495378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1287/2592] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:46.505529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:46.507054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:46.567308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ee26a-2252-4ea9-b5aa-a569dad48f59 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:46.571731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:46.572441 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:46.572714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:46.572979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:46.582794 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:46.584269 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:46.594134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1306/2593] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:46.916777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:46.918273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:46.937770 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bb921-178f-402b-9fe2-9cdfbae3dfb3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:46.943461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:46.944165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:46.944522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:46.944846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] PATH_INFO: `/v3/projects/c6c4c040012646289a8ac04d938cf6f2` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:46.946105 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c4c040012646289a8ac04d938cf6f2)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:46.948194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:46.998301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c4c040012646289a8ac04d938cf6f2', 'request_id': 'req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.003999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c4c040012646289a8ac04d938cf6f2', 'request_id': 'req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.010083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c4c040012646289a8ac04d938cf6f2', 'request_id': 'req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.023914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] The token cache is being invalidate because project c6c4c040012646289a8ac04d938cf6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:47.024200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.024833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.026321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1288/2594] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:46 2022] DELETE /identity/v3/projects/c6c4c040012646289a8ac04d938cf6f2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:47.030309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:47.040627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a85a14-c918-4c8d-883f-3438352e107f service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:47.101382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:47.102006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.102271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.102529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] PATH_INFO: `/v3/users/d3d8239185f94803a5bfc3973486d9ca` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.103740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d8239185f94803a5bfc3973486d9ca)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:47.105708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:47.158329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d8239185f94803a5bfc3973486d9ca'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.165658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d8239185f94803a5bfc3973486d9ca'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.173995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d8239185f94803a5bfc3973486d9ca'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.174598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d8239185f94803a5bfc3973486d9ca'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.176534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:47.188592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c2f413f7-719d-497d-8dc9-07626e22b925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d8239185f94803a5bfc3973486d9ca'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.195246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1307/2595] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:47 2022] DELETE /identity/v3/users/d3d8239185f94803a5bfc3973486d9ca => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:47.479684 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:47.481319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:47.495155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6469eb-d8db-43cc-a5bb-c19f4d40ec4c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:47.553534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:47.554145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.554422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.554717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] PATH_INFO: `/v3/projects/4939c3eedc13429a9b61ef033bd512dd` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.555834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4939c3eedc13429a9b61ef033bd512dd)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:47.557751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:47.607950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4939c3eedc13429a9b61ef033bd512dd', 'request_id': 'req-392cc87c-66c4-48a3-8b48-032bbfb12800'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.610195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:47.615300 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4939c3eedc13429a9b61ef033bd512dd', 'request_id': 'req-392cc87c-66c4-48a3-8b48-032bbfb12800'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.622095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4939c3eedc13429a9b61ef033bd512dd', 'request_id': 'req-392cc87c-66c4-48a3-8b48-032bbfb12800'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.636532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] The token cache is being invalidate because project 4939c3eedc13429a9b61ef033bd512dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:47.636821 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.637466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-392cc87c-66c4-48a3-8b48-032bbfb12800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:47.639015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1289/2596] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:47 2022] DELETE /identity/v3/projects/4939c3eedc13429a9b61ef033bd512dd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:47.644355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.644849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.644849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.666192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:47.667388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:47.732008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1308/2597] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:47.744857 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.745140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.745404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.766631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:47.767843 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:47.776736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1290/2598] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:47.781036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:47.791102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4297dff-3518-4dc4-8538-f421a9a683c8 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:47.795948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:47.796542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.796815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.797076 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.797735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:47.798034 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:47.799690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:47.811248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1309/2599] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:53:47.815826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:47.825234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8f5ce-06f6-402e-8792-2ddba644675c None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:47.830133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:47.830753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.831035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.831301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.831964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:47.833925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:47.864100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:47.864495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1291/2600] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:47 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:47.865759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:47.867028 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:47.878253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171224a-1d54-412b-bca5-36bf02bf0e5e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:47.939532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307db21-5940-4c1d-9e50-d66c36f3ea03 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:47.945865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:47.946666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.947903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.948255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.949020 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:47.951071 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:47.952723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:47.953399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:47.953737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:47.954012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] PATH_INFO: `/v3/users/7fc26db246b4487b9cee6d573dae5889` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:47.955200 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc26db246b4487b9cee6d573dae5889)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:47.957106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:47.979710 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1292/2601] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:47 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:47.991958 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.002538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362be4a8-b70f-497b-b2ec-4b491a1a0a0e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.008004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.008688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.010910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.011216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.011907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.013527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.024167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc26db246b4487b9cee6d573dae5889'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.028415 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1293/2602] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:48.029486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.031854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc26db246b4487b9cee6d573dae5889'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.040151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571f9f9-322f-4469-8abe-046ea666df2a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.041074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc26db246b4487b9cee6d573dae5889'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.041756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc26db246b4487b9cee6d573dae5889'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.045699 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.046862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.047271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.047586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.048292 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.050103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.050910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:48.058905 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-511b2bb4-5de7-43f6-a3c3-450061c1a0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc26db246b4487b9cee6d573dae5889'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.065486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1294/2603] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:48.066822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.068661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.073678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1310/2604] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:47 2022] DELETE /identity/v3/users/7fc26db246b4487b9cee6d573dae5889 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:48.075636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.076012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.076375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.083435 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f54d3-f09c-4855-8d90-7d3c60346327 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.096532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:48.098829 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.144202 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61934533-0768-41d9-97cc-12d3ed262b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.144865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934533-0768-41d9-97cc-12d3ed262b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.145148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934533-0768-41d9-97cc-12d3ed262b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.145419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61934533-0768-41d9-97cc-12d3ed262b96 admin admin] PATH_INFO: `/v3/projects/f854a037460f4224b61fdb0b44dbff9a/users/9b78d900811c467fa3e08525525a7563/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.157088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1311/2605] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:48.160314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61934533-0768-41d9-97cc-12d3ed262b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f854a037460f4224b61fdb0b44dbff9a, user_id=9b78d900811c467fa3e08525525a7563, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.162937 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61934533-0768-41d9-97cc-12d3ed262b96 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.166704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.168311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.177690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1295/2606] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:48 2022] PUT /identity/v3/projects/f854a037460f4224b61fdb0b44dbff9a/users/9b78d900811c467fa3e08525525a7563/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:48.188280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.188679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.188988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.196335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:48.219394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] MFA Rules not processed for user `9b78d900811c467fa3e08525525a7563`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:48.220591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.228370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c64ee-83a1-443b-b8e0-38d628a381b1 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.278993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.279608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.279874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.280247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.293559 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1296/2607] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:48.298192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.346254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:48.349662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.352351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.363826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1312/2608] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:48.366086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5e853-91ba-4051-b9d9-9d4a205d01a4 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.371007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.371902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.372053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.372234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.372929 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.374905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.407803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1297/2609] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:48.408957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.419873 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a30e-b912-4ac5-b764-c2e2d3945fcc service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.479966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.480574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.480849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.481112 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.481725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.483778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.507184 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1313/2610] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:48.509802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.520862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d6113-f2a7-4637-b723-aebf004195eb admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.525856 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.527096 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.527383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.527653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.528302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.529919 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.541791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1298/2611] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:48.546075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.556569 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054cf5-0b6e-4ad8-a10a-ca8b0e69866d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.561857 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.562623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.562932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.563204 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] PATH_INFO: `/v3/projects/36a7c20a28244620b75ccc6cd8412919/users/2d30f4e5298f46e8a4c062c004fe4e19/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.578775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a7c20a28244620b75ccc6cd8412919, user_id=2d30f4e5298f46e8a4c062c004fe4e19, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.581638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.596389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1314/2612] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:48 2022] PUT /identity/v3/projects/36a7c20a28244620b75ccc6cd8412919/users/2d30f4e5298f46e8a4c062c004fe4e19/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:48.600442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.612665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de6bc-25ed-4456-88b3-60a1ae5f49c4 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.644457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.646361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.675580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.676507 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.677029 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.677338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.678408 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.680918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.694823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1299/2613] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:48.695668 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.701287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:48.709642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79399ed9-a2f9-428b-aee9-fde9b0e51ff7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.715293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4a6a6-4f01-4db6-b72c-e2f98245d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.716043 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a6a6-4f01-4db6-b72c-e2f98245d28e admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.716632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a6a6-4f01-4db6-b72c-e2f98245d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.716752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4a6a6-4f01-4db6-b72c-e2f98245d28e admin admin] PATH_INFO: `/v3/projects/36a7c20a28244620b75ccc6cd8412919/users/2d30f4e5298f46e8a4c062c004fe4e19/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.718798 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a6a6-4f01-4db6-b72c-e2f98245d28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a7c20a28244620b75ccc6cd8412919, user_id=2d30f4e5298f46e8a4c062c004fe4e19, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.721973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4a6a6-4f01-4db6-b72c-e2f98245d28e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.731577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe474c9a-5486-4340-a755-f5ee955e079b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.748356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1300/2614] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:48 2022] PUT /identity/v3/projects/36a7c20a28244620b75ccc6cd8412919/users/2d30f4e5298f46e8a4c062c004fe4e19/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:48.750887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.751278 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.751672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.781592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] MFA Rules not processed for user `2d30f4e5298f46e8a4c062c004fe4e19`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:48.782877 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.806173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.807119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.807446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.807801 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] PATH_INFO: `/v3/projects/f0ae807b73fa4c839167f48dab6418b9` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.808913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ae807b73fa4c839167f48dab6418b9)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:48.810909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:48.823097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:48.856196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1301/2615] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:48.860850 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ae807b73fa4c839167f48dab6418b9', 'request_id': 'req-75f1c879-463a-443d-82be-9be763d34fbe'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.867784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:48.868495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ae807b73fa4c839167f48dab6418b9', 'request_id': 'req-75f1c879-463a-443d-82be-9be763d34fbe'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.869588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.875732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ae807b73fa4c839167f48dab6418b9', 'request_id': 'req-75f1c879-463a-443d-82be-9be763d34fbe'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.888833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] The token cache is being invalidate because project f0ae807b73fa4c839167f48dab6418b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:48.889122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.890026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-75f1c879-463a-443d-82be-9be763d34fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:48.891621 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1315/2616] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:48 2022] DELETE /identity/v3/projects/f0ae807b73fa4c839167f48dab6418b9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:48.896507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5334b2-3926-48ba-b23d-068461d0a7b7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.897101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5334b2-3926-48ba-b23d-068461d0a7b7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.897372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5334b2-3926-48ba-b23d-068461d0a7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.919032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-4b5334b2-3926-48ba-b23d-068461d0a7b7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:48.920446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-4b5334b2-3926-48ba-b23d-068461d0a7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.929286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c63e9-e2c7-4f29-814b-5a33a339d878 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:48.980156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:48.980757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.981033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.981345 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:48.982124 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1316/2617] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:48.988185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:48.990106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:48.990388 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:48.990767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.009906 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:49.011157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:49.019197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1317/2618] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:49.023637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.032670 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970f2af-0429-44d6-a7d1-c7355a48a8d2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.035980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:49.037825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.038424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.038702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.038999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.039608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:49.039970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.041490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.054898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1318/2619] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:49.057899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.059190 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.061012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.068757 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ad534-98a6-4f22-9ef9-f7900af0a438 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.073004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1302/2620] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:49.074079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.074852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.075132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.075399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.076015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.078121 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.109164 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1319/2621] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:49 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:49.112462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.129304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc992c99-0463-4c11-85ad-309ab6130e00 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.154898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.156666 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:49.205135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.205744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.206017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.206289 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.206946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.208878 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.233339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1303/2622] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:49 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:49.233528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f84abb-c278-4a74-81d5-32c31bf9d7a7 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.237539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.237667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.238457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.238918 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.239196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.240919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:49.248145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470085a-65be-442f-bfe1-ae5ad51ac7c6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.251718 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:49.254366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.255304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.255586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.255858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.256553 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.258134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.270159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1304/2623] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:49.275701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.286079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178fb5-72ef-4adf-a0fa-2fee4235433b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.291486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.292094 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.292394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.292642 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.293315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.295308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.310620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1305/2624] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:49.310856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.310856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3b1f7-7ade-4691-9105-903df7673b88 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.311779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.322304 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1320/2625] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:49.324873 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f1440-1c4e-408d-a367-9b8f34acb823 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.329961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.330659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.330964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.331234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] PATH_INFO: `/v3/projects/b0723f19dcc84113be13b29d240aca61/users/783546f34f8441a0be8b1e6a09bb6e16/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.348605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0723f19dcc84113be13b29d240aca61, user_id=783546f34f8441a0be8b1e6a09bb6e16, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.351624 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.369654 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1306/2626] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:49 2022] PUT /identity/v3/projects/b0723f19dcc84113be13b29d240aca61/users/783546f34f8441a0be8b1e6a09bb6e16/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:49.381160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.381640 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.381934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.425624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] MFA Rules not processed for user `783546f34f8441a0be8b1e6a09bb6e16`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:49.427068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:49.506470 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1321/2627] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:49.518977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:49.578270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee5ada-11cc-429f-9d7c-5825bc93f810 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:49.582371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c883870-3d64-47cb-8dcb-28fbced0df51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:49.583009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883870-3d64-47cb-8dcb-28fbced0df51 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:49.583283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883870-3d64-47cb-8dcb-28fbced0df51 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:49.583551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c883870-3d64-47cb-8dcb-28fbced0df51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:49.592350 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c883870-3d64-47cb-8dcb-28fbced0df51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:49.593766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c883870-3d64-47cb-8dcb-28fbced0df51 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:49.602471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1307/2628] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:52.094261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:52.095985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:52.161130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67301b5e-938a-482b-95a8-4a1a3440aa11 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:52.166610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:52.166775 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:52.167049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:52.167314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] PATH_INFO: `/v3/users/9b78d900811c467fa3e08525525a7563` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:52.168456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b78d900811c467fa3e08525525a7563)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:52.170371 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:52.220739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:52.226595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b78d900811c467fa3e08525525a7563'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.240055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b78d900811c467fa3e08525525a7563'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.251444 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b78d900811c467fa3e08525525a7563'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.251713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b78d900811c467fa3e08525525a7563'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.269268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b78d900811c467fa3e08525525a7563'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.279848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1322/2629] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:52 2022] DELETE /identity/v3/users/9b78d900811c467fa3e08525525a7563 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:52.286079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:52.286606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:52.287062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:52.309187 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:52.311074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:52.343210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:52.400055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1308/2630] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:52.410339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:52.411833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:52.473038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52d80-8786-4107-9e75-d56522dac187 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:52.477029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d79df-dc98-40cd-bcb2-1ea59ba578f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:52.477735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d79df-dc98-40cd-bcb2-1ea59ba578f8 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:52.478008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d79df-dc98-40cd-bcb2-1ea59ba578f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:52.478274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d79df-dc98-40cd-bcb2-1ea59ba578f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:52.491024 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d79df-dc98-40cd-bcb2-1ea59ba578f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:52.492706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d79df-dc98-40cd-bcb2-1ea59ba578f8 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:52.504027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1323/2631] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:52.788596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:52.790112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:52.802804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83804ac2-25be-4ea6-8465-527d3737c604 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:52.808012 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:52.808652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:52.808930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:52.809448 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] PATH_INFO: `/v3/projects/f854a037460f4224b61fdb0b44dbff9a` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:52.810320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f854a037460f4224b61fdb0b44dbff9a)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:52.812264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:52.859493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f854a037460f4224b61fdb0b44dbff9a', 'request_id': 'req-289eb9a7-a174-428d-996d-4128e4f0d74d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.860268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:52.860550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:52.860819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:52.865193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f854a037460f4224b61fdb0b44dbff9a', 'request_id': 'req-289eb9a7-a174-428d-996d-4128e4f0d74d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.871583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f854a037460f4224b61fdb0b44dbff9a', 'request_id': 'req-289eb9a7-a174-428d-996d-4128e4f0d74d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.880827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:52.882032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:52.885060 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] The token cache is being invalidate because project f854a037460f4224b61fdb0b44dbff9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:52.885375 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.885994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:52.887574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1309/2632] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:52 2022] DELETE /identity/v3/projects/f854a037460f4224b61fdb0b44dbff9a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:52.891613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:52.893108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:52.945894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1324/2633] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:52.957367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289eb9a7-a174-428d-996d-4128e4f0d74d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:52.962535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:52.963199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:52.963476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:52.963751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] PATH_INFO: `/v3/users/2d30f4e5298f46e8a4c062c004fe4e19` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:52.964896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d30f4e5298f46e8a4c062c004fe4e19)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:52.967147 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:52.970208 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:52.971917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:53.016447 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d30f4e5298f46e8a4c062c004fe4e19'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.020075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:53.024961 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d30f4e5298f46e8a4c062c004fe4e19'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.034196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d30f4e5298f46e8a4c062c004fe4e19'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.034910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d30f4e5298f46e8a4c062c004fe4e19'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.046840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d30f4e5298f46e8a4c062c004fe4e19'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.048468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:53.054086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1310/2634] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:52 2022] DELETE /identity/v3/users/2d30f4e5298f46e8a4c062c004fe4e19 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:53.056783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255bbda-30da-4426-bd8a-a48bcbb12a8b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.121551 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.122245 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.122600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.122920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.125381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:53.215419 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.218496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e3326-9165-4358-a203-9f0c1db65717 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.235368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1325/2635] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:53.368936 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.370524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:53.387416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b327c0-0956-4a4d-a34f-1df8b32df1e8 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.395752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.396634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.397353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.397752 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] PATH_INFO: `/v3/projects/36a7c20a28244620b75ccc6cd8412919` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.399075 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a7c20a28244620b75ccc6cd8412919)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.401249 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.463716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a7c20a28244620b75ccc6cd8412919', 'request_id': 'req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.471632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a7c20a28244620b75ccc6cd8412919', 'request_id': 'req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.478259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a7c20a28244620b75ccc6cd8412919', 'request_id': 'req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.491954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] The token cache is being invalidate because project 36a7c20a28244620b75ccc6cd8412919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:53.492271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.492897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-70bdaabe-c5b5-42d7-99ae-d046d3e29a1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:53.494635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1311/2636] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:53 2022] DELETE /identity/v3/projects/36a7c20a28244620b75ccc6cd8412919 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:53.499635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.499900 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.500174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.520242 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:53.521492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:53.602452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1326/2637] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:53.611387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.611671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.611950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.632822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:53.634038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:53.644257 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1312/2638] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:53.649139 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.660094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd77b1-e75c-4ddb-a02d-73903afde154 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.665560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.666158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.666432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.666705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.667381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:53.667677 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.669275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.681505 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1327/2639] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:53.686285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.696498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f1bbf-30ac-460c-9d8a-ff6645fb0c2e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.701566 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.702157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.702469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.702772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.703402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.705293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.736426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1313/2640] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:53 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:53.742950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.755809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58b580-eb37-459a-90f7-30f907e7c3e9 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.775791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:53.814867 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.815462 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.815737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.816014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.817001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.819198 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.843222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1328/2641] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:53 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:53.847195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.858494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69f51a-7121-4cef-afcf-bf2b672f852d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.863888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.864528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.864802 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.865069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.865709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.867358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.877256 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1314/2642] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:53.881299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.892153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e485d8-0017-4f79-ad50-ffea5862f8ae admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.899182 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ce30b-cf08-4464-898a-39286d3b24ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.899824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce30b-cf08-4464-898a-39286d3b24ac admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.900101 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce30b-cf08-4464-898a-39286d3b24ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.900367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ce30b-cf08-4464-898a-39286d3b24ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.901012 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ce30b-cf08-4464-898a-39286d3b24ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.902633 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ce30b-cf08-4464-898a-39286d3b24ac admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.914555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1329/2643] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:53.919111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:53.929238 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7b007-ef26-44f7-90ce-b9b683f741bf admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:53.933811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:53.934451 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.934753 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.935024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] PATH_INFO: `/v3/projects/3e1bc87175164072ac4240cd3af321e3/users/2d976e0659974ea59188fe03f212470d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:53.949689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1bc87175164072ac4240cd3af321e3, user_id=2d976e0659974ea59188fe03f212470d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:53.952369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:53.971286 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1315/2644] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:53 2022] PUT /identity/v3/projects/3e1bc87175164072ac4240cd3af321e3/users/2d976e0659974ea59188fe03f212470d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:53.981701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:53.982038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:53.982307 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.012171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] MFA Rules not processed for user `2d976e0659974ea59188fe03f212470d`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:54.013338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.077672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1330/2645] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:54.082930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.142465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:54.161518 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21551d9e-985e-4a3c-90e9-dc9d551927e9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.167093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.167800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.168271 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.168576 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.169279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.171696 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.207370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1316/2646] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:54 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:54.208647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.219834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63b063-5104-4202-b6bb-b6e8db4d7cbc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.300885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.303138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.378461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba563ef6-42d1-46f8-bd5e-c4b14f69b735 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.383195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.383829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.384104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.384374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] PATH_INFO: `/v3/users/4a7d0fda446049c8a947d5234f647b07` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.385535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7d0fda446049c8a947d5234f647b07)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.387481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.414733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.415382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.415683 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.415949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.416568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.418662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.435949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7d0fda446049c8a947d5234f647b07'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:54.441225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1331/2647] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:54 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:54.444069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7d0fda446049c8a947d5234f647b07'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:54.445836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.453692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7d0fda446049c8a947d5234f647b07'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:54.454444 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7d0fda446049c8a947d5234f647b07'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:54.456000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb90879-02b8-4709-ba5f-dae470c8f670 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.460824 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.461431 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.461686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.461945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.462627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.464283 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.467980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-511b7ca5-9724-4c63-bbe0-672b42fe43f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7d0fda446049c8a947d5234f647b07'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:54.474064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1317/2648] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:54 2022] DELETE /identity/v3/users/4a7d0fda446049c8a947d5234f647b07 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:54.477116 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1332/2649] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:54.478418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.478708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.478985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.479094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.480702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.493029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c1981-9768-4f07-9d88-53606ba33a51 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.498030 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:54.498178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:54.499430 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.549604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:54.554339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.555096 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.555570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.555878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] PATH_INFO: `/v3/projects/73325ab278584599af4306141f1223cb/users/eec68d0ae3d245068bc9f43a3e8ff1d1/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.563137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1318/2650] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:54.572954 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.574053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73325ab278584599af4306141f1223cb, user_id=eec68d0ae3d245068bc9f43a3e8ff1d1, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.574296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.576756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.594332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1333/2651] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:54 2022] PUT /identity/v3/projects/73325ab278584599af4306141f1223cb/users/eec68d0ae3d245068bc9f43a3e8ff1d1/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:54.597996 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.641697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9a98-01e0-4165-b27c-6221c5a4f25d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.676216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8330ff6-a6ac-44b0-9fc9-9fa70619a059 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.683061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.684190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.684476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.685021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.685826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.687970 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.693223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d39a2-2acb-4016-8ab3-64b06e51c030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.693945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d39a2-2acb-4016-8ab3-64b06e51c030 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.694318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d39a2-2acb-4016-8ab3-64b06e51c030 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.694708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d39a2-2acb-4016-8ab3-64b06e51c030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.700894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1334/2652] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:54.704778 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.712909 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d39a2-2acb-4016-8ab3-64b06e51c030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.714470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d39a2-2acb-4016-8ab3-64b06e51c030 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.717752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6aefe8-59be-4fa5-8cca-9f935da6c867 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.724628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.725300 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.725864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.726173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] PATH_INFO: `/v3/projects/73325ab278584599af4306141f1223cb/users/eec68d0ae3d245068bc9f43a3e8ff1d1/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.728334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73325ab278584599af4306141f1223cb, user_id=eec68d0ae3d245068bc9f43a3e8ff1d1, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.730148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1319/2653] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:54.730987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:54.745724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1335/2654] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:54 2022] PUT /identity/v3/projects/73325ab278584599af4306141f1223cb/users/eec68d0ae3d245068bc9f43a3e8ff1d1/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:54.756664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.756952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.757294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.792588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] MFA Rules not processed for user `eec68d0ae3d245068bc9f43a3e8ff1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:54.794208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.876655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1320/2655] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:54.889616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:54.891498 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:54.956263 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ea744-e0f8-440b-8723-9531199b3b9d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:54.960069 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:54.960817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:54.961091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:54.961724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:54.973710 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:54.975734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:55.001868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1336/2656] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:55.043742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:55.045391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:55.109498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:55.134543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e8ec-07eb-45fb-a7af-e073f7820980 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:55.139389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:55.140048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:55.140470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:55.140734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] PATH_INFO: `/v3/projects/5c51efd3f5614070ad15692a5df4a70b` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:55.141882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c51efd3f5614070ad15692a5df4a70b)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:55.143840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:55.197520 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c51efd3f5614070ad15692a5df4a70b', 'request_id': 'req-bbcfc142-a577-413e-b023-c2dcf7c6036e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.204062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c51efd3f5614070ad15692a5df4a70b', 'request_id': 'req-bbcfc142-a577-413e-b023-c2dcf7c6036e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.210626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c51efd3f5614070ad15692a5df4a70b', 'request_id': 'req-bbcfc142-a577-413e-b023-c2dcf7c6036e'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.226293 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] The token cache is being invalidate because project 5c51efd3f5614070ad15692a5df4a70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:55.226580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.227156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.228635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1321/2657] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:55 2022] DELETE /identity/v3/projects/5c51efd3f5614070ad15692a5df4a70b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:55.232713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:55.244423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23195fa1-3dd4-4b5d-b943-1534b87a1021 service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:55.257717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:55.303765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:55.304396 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:55.304672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:55.304939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] PATH_INFO: `/v3/users/15d8b30ce9924a7abc92c51bfa0e9a91` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:55.306054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d8b30ce9924a7abc92c51bfa0e9a91)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:55.307991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:55.359945 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d8b30ce9924a7abc92c51bfa0e9a91'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.367090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d8b30ce9924a7abc92c51bfa0e9a91'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.376020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d8b30ce9924a7abc92c51bfa0e9a91'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.376685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d8b30ce9924a7abc92c51bfa0e9a91'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.391827 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2f17333c-dbaf-4cc2-92fd-8938ac18c9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d8b30ce9924a7abc92c51bfa0e9a91'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.398296 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1337/2658] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:55 2022] DELETE /identity/v3/users/15d8b30ce9924a7abc92c51bfa0e9a91 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:55.697362 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:55.698887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:55.719142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfc142-a577-413e-b023-c2dcf7c6036e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:55.792795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:55.793552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:55.793833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:55.794109 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] PATH_INFO: `/v3/projects/ca4f15a3fa2d4dfaafb99a0013407979` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:55.799941 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4f15a3fa2d4dfaafb99a0013407979)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:55.801945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:55.888544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4f15a3fa2d4dfaafb99a0013407979', 'request_id': 'req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.894139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4f15a3fa2d4dfaafb99a0013407979', 'request_id': 'req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.901867 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4f15a3fa2d4dfaafb99a0013407979', 'request_id': 'req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.913000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:55.918496 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] The token cache is being invalidate because project ca4f15a3fa2d4dfaafb99a0013407979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:55.918939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.919767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7fe80b9b-b95d-479e-aa9f-cc4bc45bffb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:55.922093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1322/2659] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:55 2022] DELETE /identity/v3/projects/ca4f15a3fa2d4dfaafb99a0013407979 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:55.927381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dcd3b-c235-4e28-a4ad-b6b3d3ff034d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:55.927835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dcd3b-c235-4e28-a4ad-b6b3d3ff034d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:55.928210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dcd3b-c235-4e28-a4ad-b6b3d3ff034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:55.948555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5b0dcd3b-c235-4e28-a4ad-b6b3d3ff034d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:55.949796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5b0dcd3b-c235-4e28-a4ad-b6b3d3ff034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.022538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.022858 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.023135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.031055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1338/2660] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:56.040192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.040536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.040891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.051754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:56.053361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.062529 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:56.063746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.065495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1323/2661] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:56.079429 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1339/2662] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:56.080772 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.086481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.088686 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.104689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0851e-5918-4fd1-9992-2bdcbb52dfd5 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.109832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.110441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.110749 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.111814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.111814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:56.112144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.114166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.136532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1324/2663] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:56.137686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.155787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:56.162861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd28f3-1f00-416c-9c5c-5bdc660405b2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.167976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.168513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.168790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.169184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.170055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.171966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.224388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1325/2664] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/projects => generated 401 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:56.233355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.274464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ffcf4-b3f9-45f1-8c7f-7a9016385071 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.344973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afae9b5-146c-4912-8513-79aa4cebf350 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.351898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.352513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.352811 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.353669 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.354740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.357266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.387476 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.388478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.390880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.392130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.401988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1326/2665] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/users => generated 301 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:56.407446 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.417205 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.419382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.420790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdaa8f-4717-468a-aa11-03d5a4e39a65 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.431657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1340/2666] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:56.431853 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.432376 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.432832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.433139 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.434339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.436035 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.451645 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1327/2667] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:56.453762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.467094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be55067-d327-478d-adc0-fbab817b87bd service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.475061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684509f-8edc-4ee1-b9b7-7bfa00b95676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.476669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684509f-8edc-4ee1-b9b7-7bfa00b95676 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.477898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684509f-8edc-4ee1-b9b7-7bfa00b95676 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.478313 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684509f-8edc-4ee1-b9b7-7bfa00b95676 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.479133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684509f-8edc-4ee1-b9b7-7bfa00b95676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.482769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684509f-8edc-4ee1-b9b7-7bfa00b95676 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.500232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1341/2668] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:56.504550 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.518470 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad371bde-3f18-4059-bfba-18536062a7fd admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.524384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.525087 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.525370 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.525638 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] PATH_INFO: `/v3/projects/ac5c10fccad44cf6b41d9ad9cd2bdf9a/users/76faeda96e764ea98aaed23eee5a07cc/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.546063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5c10fccad44cf6b41d9ad9cd2bdf9a, user_id=76faeda96e764ea98aaed23eee5a07cc, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.548887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.574890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1328/2669] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:56 2022] PUT /identity/v3/projects/ac5c10fccad44cf6b41d9ad9cd2bdf9a/users/76faeda96e764ea98aaed23eee5a07cc/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:56.581739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.582021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.582298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.616206 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] MFA Rules not processed for user `76faeda96e764ea98aaed23eee5a07cc`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:56.617567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.692912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1342/2670] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:56.697570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.708059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.709400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.745319 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:56.765136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634856f-300c-4b1d-a822-e80dfa11a9f2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.769828 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.770432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.770777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.771155 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.771795 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.774625 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.776231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee4e4d-3431-4df7-851f-410bc87f1251 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.780890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.781513 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.781787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.782050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] PATH_INFO: `/v3/users/2d976e0659974ea59188fe03f212470d` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.783189 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d976e0659974ea59188fe03f212470d)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.785103 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.789912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:56.803659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1329/2671] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:56.807845 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.834230 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d976e0659974ea59188fe03f212470d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:56.841582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d976e0659974ea59188fe03f212470d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:56.849787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d976e0659974ea59188fe03f212470d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:56.850562 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d976e0659974ea59188fe03f212470d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:56.867353 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-18bbaead-0667-49ac-9821-1fb2578b99f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d976e0659974ea59188fe03f212470d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:56.872648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0483e-1710-4818-a46a-ff3579d78f5c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.873672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1343/2672] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:56 2022] DELETE /identity/v3/users/2d976e0659974ea59188fe03f212470d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:56.877820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.878147 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.878450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.898464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:56.899709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.938993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.939659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.940047 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.940323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.941488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.943709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:56.960525 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1344/2673] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:56.970566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.971986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.972366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1330/2674] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:56 2022] POST /identity/v3/users => generated 306 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:56.976050 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:56.977640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:56.989582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68301-593b-4806-a720-376309dafae7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:56.994783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:56.995338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:56.995618 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:56.995888 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:56.996527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:56.998131 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.008983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1331/2675] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:57.013118 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.023866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923ee6d-6a52-4e6c-b6e9-964c92253530 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.028816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.029453 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.029731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.030004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] PATH_INFO: `/v3/projects/4c429bf63b594721b10a0e3de8411ffb/users/fbe776bad63b4c6193bcc0ef41f4bb9c/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.035803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7884e4-f79e-451b-921f-7a8b347b3084 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.039468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.040070 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.040342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.040755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.045722 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c429bf63b594721b10a0e3de8411ffb, user_id=fbe776bad63b4c6193bcc0ef41f4bb9c, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.048000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:57.049143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.050966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.053369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.065067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1332/2676] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:57 2022] PUT /identity/v3/projects/4c429bf63b594721b10a0e3de8411ffb/users/fbe776bad63b4c6193bcc0ef41f4bb9c/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:57.065841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1345/2677] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:57.069192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.130010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:57.134099 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2decde-6ffe-4c05-9317-133d1fb53432 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.141103 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c805e-fd0a-437b-96d9-6b71733a5642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.141912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c805e-fd0a-437b-96d9-6b71733a5642 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.142290 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c805e-fd0a-437b-96d9-6b71733a5642 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.142692 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c805e-fd0a-437b-96d9-6b71733a5642 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.143508 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c805e-fd0a-437b-96d9-6b71733a5642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.145205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c805e-fd0a-437b-96d9-6b71733a5642 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.155997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1333/2678] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:57.160384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.171617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbbbcf-c790-47ac-ad1a-b2adb8b844b3 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.178607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.179325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.179607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.179876 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] PATH_INFO: `/v3/projects/4c429bf63b594721b10a0e3de8411ffb/users/fbe776bad63b4c6193bcc0ef41f4bb9c/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.182137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c429bf63b594721b10a0e3de8411ffb, user_id=fbe776bad63b4c6193bcc0ef41f4bb9c, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.186172 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.199729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1346/2679] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:57 2022] PUT /identity/v3/projects/4c429bf63b594721b10a0e3de8411ffb/users/fbe776bad63b4c6193bcc0ef41f4bb9c/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:57.215234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.215234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.215234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.243808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] MFA Rules not processed for user `fbe776bad63b4c6193bcc0ef41f4bb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:57.245021 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:57.311977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1334/2680] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:57.323445 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.326517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:57.356665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.358627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:57.443987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9f2b42-fb4b-4018-8816-1cf6d1e69d11 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.447724 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.448018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b00b4-0893-47db-a1fb-d449a5adbed4 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.448466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.448835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.449295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.453052 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.453689 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.453973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.454243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] PATH_INFO: `/v3/projects/3e1bc87175164072ac4240cd3af321e3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.455407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1bc87175164072ac4240cd3af321e3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.457318 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.460990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.462731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.474947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1347/2681] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:57.514120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1bc87175164072ac4240cd3af321e3', 'request_id': 'req-3f4aee6c-047e-4cdd-8604-68811af63b87'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.520592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1bc87175164072ac4240cd3af321e3', 'request_id': 'req-3f4aee6c-047e-4cdd-8604-68811af63b87'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.527718 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1bc87175164072ac4240cd3af321e3', 'request_id': 'req-3f4aee6c-047e-4cdd-8604-68811af63b87'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.541660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] The token cache is being invalidate because project 3e1bc87175164072ac4240cd3af321e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:57.541948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.542589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.544137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1335/2682] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:57 2022] DELETE /identity/v3/projects/3e1bc87175164072ac4240cd3af321e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:53:57.554376 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.561657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:57.563533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:57.564923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f82794-5989-4860-a5b7-694ca67cb9d7 service cinder] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.575899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:57.630368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4aee6c-047e-4cdd-8604-68811af63b87 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:57.630762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.631522 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.631932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.632180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] PATH_INFO: `/v3/users/eec68d0ae3d245068bc9f43a3e8ff1d1` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.634080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:57.634209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec68d0ae3d245068bc9f43a3e8ff1d1)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.634701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:57.634994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:57.635285 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:57.636406 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.637057 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:57.693129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec68d0ae3d245068bc9f43a3e8ff1d1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.701466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec68d0ae3d245068bc9f43a3e8ff1d1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.710592 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec68d0ae3d245068bc9f43a3e8ff1d1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.711271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec68d0ae3d245068bc9f43a3e8ff1d1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.711534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:57.712981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:57.723822 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1336/2683] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:53:57.725225 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c651eab1-cdcf-4104-b169-77e987c96fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec68d0ae3d245068bc9f43a3e8ff1d1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:57.735222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1348/2684] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:53:57 2022] DELETE /identity/v3/users/eec68d0ae3d245068bc9f43a3e8ff1d1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:58.096209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.098175 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:58.113998 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d21203-cb5f-4119-8151-add21131d2ae service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.175448 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.175962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.176264 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.176512 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] PATH_INFO: `/v3/projects/73325ab278584599af4306141f1223cb` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.177780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=73325ab278584599af4306141f1223cb)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.179804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.233121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73325ab278584599af4306141f1223cb', 'request_id': 'req-ad5aed8f-daab-4843-a22e-54b32d3dc21b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:58.239460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73325ab278584599af4306141f1223cb', 'request_id': 'req-ad5aed8f-daab-4843-a22e-54b32d3dc21b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:58.246132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73325ab278584599af4306141f1223cb', 'request_id': 'req-ad5aed8f-daab-4843-a22e-54b32d3dc21b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:58.248640 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:58.260524 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] The token cache is being invalidate because project 73325ab278584599af4306141f1223cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:53:58.260810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:58.261463 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ad5aed8f-daab-4843-a22e-54b32d3dc21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:53:58.263010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1337/2685] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:53:58 2022] DELETE /identity/v3/projects/73325ab278584599af4306141f1223cb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:58.267908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.268191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.268464 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.277210 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:58.292047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:58.293280 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:58.357131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1349/2686] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:58.364979 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.365252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.365544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.385462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:58.386633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:58.394803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1338/2687] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:58.399517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.409650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da79a-12bb-453f-97c9-cfdebaa7764f None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.415011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.415607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.415881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.416178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.416819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:53:58.417117 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.418743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.430223 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1350/2688] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:53:58.434514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.444226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdfe31-b4a9-43da-a6ad-0fb91a140242 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.449956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.450585 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.450890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.451281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.451841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.453983 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.484111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1339/2689] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:58.489734 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.501221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb2f95-5111-4774-bba5-f9e29cfd2288 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.566977 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.567623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.567898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.568166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.568791 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.570726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.594924 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1351/2690] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:58.600174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.611465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b948f-00ff-4cd1-a819-d71d396176e6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.618032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.618759 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.619033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.619296 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.619934 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.621532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.632304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1340/2691] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:58.636743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.647552 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db56e6-76a5-4bd5-b0cb-39e32d9908ef admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.652032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440454-eed3-4f94-8a89-27a11d2a12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.652619 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440454-eed3-4f94-8a89-27a11d2a12a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.652891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440454-eed3-4f94-8a89-27a11d2a12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.653152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440454-eed3-4f94-8a89-27a11d2a12a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.653787 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c440454-eed3-4f94-8a89-27a11d2a12a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.655437 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c440454-eed3-4f94-8a89-27a11d2a12a5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.666079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1352/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:53:58.670330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.680886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5407bf-c125-4dfb-80c1-ff9e7cd80a2d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.686443 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.687137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.687486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.687701 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] PATH_INFO: `/v3/projects/08fe253035a142c99c753fd6adcb1555/users/97a06a5aa4164bbaad91a60b9d9a0a7e/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.703488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=08fe253035a142c99c753fd6adcb1555, user_id=97a06a5aa4164bbaad91a60b9d9a0a7e, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.706702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.720491 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1341/2693] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:58 2022] PUT /identity/v3/projects/08fe253035a142c99c753fd6adcb1555/users/97a06a5aa4164bbaad91a60b9d9a0a7e/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:58.733593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.733916 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.734390 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.764937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] MFA Rules not processed for user `97a06a5aa4164bbaad91a60b9d9a0a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:58.766218 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:58.829374 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:58.833983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1353/2694] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:58.839397 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.904926 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152475b-6c9a-4d0d-b26d-aee4287b42ce admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:58.909715 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:58.910323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:58.910599 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:58.910899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:58.911536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:58.913589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:58.946420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1342/2695] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:53:58.950409 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:58.964440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16aa549-4ec7-4146-8cc5-9937265e34e7 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.032843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.033602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.033947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.034355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.038168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.040295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.066082 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1354/2696] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:53:58 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:53:59.070526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:59.083677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b51a2-aafe-4542-913e-194f81fc5365 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.094262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.095115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.095538 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.095966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.096773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.098537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.110460 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1343/2697] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:59.114536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:59.125180 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97e754-79e5-424c-89f3-85b88d1b415c admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.130910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.131667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.131983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.132250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] PATH_INFO: `/v3/projects/5939c212f3c34ecb9c611302fa4382f3/users/759ccf468a1e4e4aab25beeed56e2d35/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.162475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5939c212f3c34ecb9c611302fa4382f3, user_id=759ccf468a1e4e4aab25beeed56e2d35, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.165953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.191033 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1355/2698] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:59 2022] PUT /identity/v3/projects/5939c212f3c34ecb9c611302fa4382f3/users/759ccf468a1e4e4aab25beeed56e2d35/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:59.193579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:59.204917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8169d-7b93-4ff9-8cbb-bdedf014f440 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.267476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b9482-5592-4954-9b14-4ddc751758b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.268080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b9482-5592-4954-9b14-4ddc751758b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.268355 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b9482-5592-4954-9b14-4ddc751758b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.268622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b9482-5592-4954-9b14-4ddc751758b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.269266 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b9482-5592-4954-9b14-4ddc751758b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.270872 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b9482-5592-4954-9b14-4ddc751758b6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.276776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:59.285467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1344/2699] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:53:59.286177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:59.296819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c14c2-4f53-4953-b1c1-967331f03533 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.301879 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4e05a-ed00-4087-87ee-9ed79d95b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.302559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4e05a-ed00-4087-87ee-9ed79d95b3df admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.302835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4e05a-ed00-4087-87ee-9ed79d95b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.303094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4e05a-ed00-4087-87ee-9ed79d95b3df admin admin] PATH_INFO: `/v3/projects/5939c212f3c34ecb9c611302fa4382f3/users/759ccf468a1e4e4aab25beeed56e2d35/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.305160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4e05a-ed00-4087-87ee-9ed79d95b3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5939c212f3c34ecb9c611302fa4382f3, user_id=759ccf468a1e4e4aab25beeed56e2d35, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.308081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4e05a-ed00-4087-87ee-9ed79d95b3df admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.319384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1356/2700] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:53:59 2022] PUT /identity/v3/projects/5939c212f3c34ecb9c611302fa4382f3/users/759ccf468a1e4e4aab25beeed56e2d35/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:53:59.330769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.331088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.331330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.360838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] MFA Rules not processed for user `759ccf468a1e4e4aab25beeed56e2d35`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:59.362107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:59.387209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.387784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.387784 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.412234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:53:59.413584 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:59.471203 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1345/2701] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:53:59.482755 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:59.484241 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:59.489332 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1357/2702] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:53:59.512767 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:53:59.514266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:53:59.542014 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9377d-5a0e-40cd-a383-51ea319e22c3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.545751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.546449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.546763 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.547042 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.567646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:59.592219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d65b2d-739f-42b1-882e-0a0005c69e3b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:53:59.599323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:53:59.600160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:53:59.600160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:53:59.600460 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:53:59.611305 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.612531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:53:59.612912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.613964 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:53:59.622427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1358/2703] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:53:59.624210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1346/2704] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:01.030228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:01.040287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4a72d-0fe5-465a-9ba0-0df4f218174d service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:01.044040 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacda572-9e01-43e5-889d-9c9bee2c961c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:01.044665 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda572-9e01-43e5-889d-9c9bee2c961c service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:01.044938 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda572-9e01-43e5-889d-9c9bee2c961c service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:01.045229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda572-9e01-43e5-889d-9c9bee2c961c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:01.054720 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacda572-9e01-43e5-889d-9c9bee2c961c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:01.056146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacda572-9e01-43e5-889d-9c9bee2c961c service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:01.065848 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1359/2705] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:01.455529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:01.457130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:01.472352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7659b-4911-4c88-b552-fe0645ec7993 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:01.478740 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:01.479288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:01.479558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:01.479825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] PATH_INFO: `/v3/users/783546f34f8441a0be8b1e6a09bb6e16` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:01.481073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783546f34f8441a0be8b1e6a09bb6e16)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:01.483010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:01.525314 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:01.535921 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783546f34f8441a0be8b1e6a09bb6e16'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:01.544164 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783546f34f8441a0be8b1e6a09bb6e16'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:01.551157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783546f34f8441a0be8b1e6a09bb6e16'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:01.551774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783546f34f8441a0be8b1e6a09bb6e16'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:01.563171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783546f34f8441a0be8b1e6a09bb6e16'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:01.568825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1347/2706] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:01 2022] DELETE /identity/v3/users/783546f34f8441a0be8b1e6a09bb6e16 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:01.573410 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:01.573702 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:01.573979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:01.594087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:01.595699 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:01.657820 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1360/2707] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:01.669840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:01.672152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:01.736141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1784-024c-4437-b86b-5435b3039896 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:01.739711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f9064-c45c-40b5-a4e9-dc2d22a50bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:01.740309 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f9064-c45c-40b5-a4e9-dc2d22a50bff service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:01.740583 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f9064-c45c-40b5-a4e9-dc2d22a50bff service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:01.740847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f9064-c45c-40b5-a4e9-dc2d22a50bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:01.750574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f9064-c45c-40b5-a4e9-dc2d22a50bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:01.752056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f9064-c45c-40b5-a4e9-dc2d22a50bff service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:01.761577 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1348/2708] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:01.918338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:01.919985 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:01.932177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f3b5-c36c-49e4-8ef1-e6d304a1c98a None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:01.937618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:01.938244 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:01.938517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:01.938819 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] PATH_INFO: `/v3/users/76faeda96e764ea98aaed23eee5a07cc` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:01.940052 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=76faeda96e764ea98aaed23eee5a07cc)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:01.942053 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.001279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76faeda96e764ea98aaed23eee5a07cc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.008872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76faeda96e764ea98aaed23eee5a07cc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.017668 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76faeda96e764ea98aaed23eee5a07cc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.018322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76faeda96e764ea98aaed23eee5a07cc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.030902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76faeda96e764ea98aaed23eee5a07cc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.036853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1361/2709] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:01 2022] DELETE /identity/v3/users/76faeda96e764ea98aaed23eee5a07cc => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:02.041562 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.041881 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.042196 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.062484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:02.063717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.068348 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.070256 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.113496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:02.127905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1349/2710] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:02.138080 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.139038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54467da-7809-42de-a6d5-781c367ad85e admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.139537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.143728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.144363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.144645 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.144971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] PATH_INFO: `/v3/projects/b0723f19dcc84113be13b29d240aca61` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.146167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0723f19dcc84113be13b29d240aca61)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.148652 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.195826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0723f19dcc84113be13b29d240aca61', 'request_id': 'req-fbf30700-0e36-4c9a-997a-5db34df888b4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.197157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbfd20-5c1a-4153-a986-ea42deeac501 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.201385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0723f19dcc84113be13b29d240aca61', 'request_id': 'req-fbf30700-0e36-4c9a-997a-5db34df888b4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.204917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:02.208214 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0723f19dcc84113be13b29d240aca61', 'request_id': 'req-fbf30700-0e36-4c9a-997a-5db34df888b4'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.221882 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] The token cache is being invalidate because project b0723f19dcc84113be13b29d240aca61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:02.222168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.222834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-fbf30700-0e36-4c9a-997a-5db34df888b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.224337 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1362/2711] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:02 2022] DELETE /identity/v3/projects/b0723f19dcc84113be13b29d240aca61 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:02.229483 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4a18b-f899-4aaf-b0ac-72347a304a9c None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.229828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4a18b-f899-4aaf-b0ac-72347a304a9c None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.230105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4a18b-f899-4aaf-b0ac-72347a304a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.250486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.251133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.251407 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.251672 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.252219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-42f4a18b-f899-4aaf-b0ac-72347a304a9c None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:02.254605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-42f4a18b-f899-4aaf-b0ac-72347a304a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.254865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.329740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1363/2712] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:02.337854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386dd5d-3bfe-46b4-99f1-5b21adcb07f8 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.338542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386dd5d-3bfe-46b4-99f1-5b21adcb07f8 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.339027 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386dd5d-3bfe-46b4-99f1-5b21adcb07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.348001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.349833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.366327 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0386dd5d-3bfe-46b4-99f1-5b21adcb07f8 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:02.367011 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1350/2713] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:54:02.369984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0386dd5d-3bfe-46b4-99f1-5b21adcb07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.381047 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1364/2714] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:02.385874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.400310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48676f3d-ccbe-4367-909a-93c728ade826 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.405405 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.406193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.406476 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.406777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.407488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:54:02.407791 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.409386 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.412991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.413517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.414013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.425726 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1351/2715] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:54:02.430412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.439749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:02.441271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.441733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae85034-a58b-4cb5-9457-cfed48d71aed admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.448323 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.448977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.449258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.449529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.450102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1365/2716] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:02.450303 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.452486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.473197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.474812 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.484830 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1352/2717] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:54:02.490064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.545616 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:02.576219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274363a-c81a-4286-8fa7-e8c0814f0b1e None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.604301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa500a3b-119f-4577-b067-82b7fe8949c2 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.612935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.614658 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.615258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.615717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.616464 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.620281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.652973 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1353/2718] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:02.656705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.657115 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.657485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.658898 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.659236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.672316 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058836ab-6cd1-44e3-937e-131a73098aaf admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.674216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.676635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.681765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.682291 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.682992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.683287 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.683947 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.685543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.688438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1366/2719] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:54:02.699062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1354/2720] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:54:02.702481 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.718605 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7bdae-0cba-4e3e-aa73-052514e6e66a service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.724671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.725261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.725528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.725947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.726494 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.728423 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.742814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1367/2721] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:02.744523 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.753159 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:02.757369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.761183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac6534-87db-4c1b-843f-e9d00623a88e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.761902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.769378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084cb6-d54c-4548-9c2d-8300e8cfd5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.770137 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084cb6-d54c-4548-9c2d-8300e8cfd5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.770481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084cb6-d54c-4548-9c2d-8300e8cfd5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.771022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084cb6-d54c-4548-9c2d-8300e8cfd5a1 admin admin] PATH_INFO: `/v3/projects/4110d845a76a421aa2173093f88ac5d8/users/507f5b173f924cb89d001a317c0ce0c5/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.779201 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63129ff-2f37-45d4-b294-9986d7277f1a admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.784251 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.784881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.785093 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.785368 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] PATH_INFO: `/v3/projects/ac5c10fccad44cf6b41d9ad9cd2bdf9a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.787166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5c10fccad44cf6b41d9ad9cd2bdf9a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.789488 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.789882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084cb6-d54c-4548-9c2d-8300e8cfd5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4110d845a76a421aa2173093f88ac5d8, user_id=507f5b173f924cb89d001a317c0ce0c5, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.792825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084cb6-d54c-4548-9c2d-8300e8cfd5a1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.808473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1355/2722] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:02 2022] PUT /identity/v3/projects/4110d845a76a421aa2173093f88ac5d8/users/507f5b173f924cb89d001a317c0ce0c5/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:54:02.813612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1826-305f-4264-b96b-3718e3161351 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.813896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1826-305f-4264-b96b-3718e3161351 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.814163 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1826-305f-4264-b96b-3718e3161351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.834605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-436c1826-305f-4264-b96b-3718e3161351 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:02.836173 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-436c1826-305f-4264-b96b-3718e3161351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.848471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5c10fccad44cf6b41d9ad9cd2bdf9a', 'request_id': 'req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.853955 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5c10fccad44cf6b41d9ad9cd2bdf9a', 'request_id': 'req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.862739 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5c10fccad44cf6b41d9ad9cd2bdf9a', 'request_id': 'req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.877088 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] The token cache is being invalidate because project ac5c10fccad44cf6b41d9ad9cd2bdf9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:02.877385 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.878026 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:02.880331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1368/2723] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:02 2022] DELETE /identity/v3/projects/ac5c10fccad44cf6b41d9ad9cd2bdf9a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:02.884115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.885428 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.897648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1356/2724] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:02.907540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1826-305f-4264-b96b-3718e3161351 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:02.908903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-436c1826-305f-4264-b96b-3718e3161351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:02.938809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:02.953502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca03c3b-d318-4f96-aaf9-6d5fd53f2f15 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.959351 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.959987 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.960267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.960536 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] PATH_INFO: `/v3/users/fbe776bad63b4c6193bcc0ef41f4bb9c` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.961716 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe776bad63b4c6193bcc0ef41f4bb9c)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.963672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.967063 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1826-305f-4264-b96b-3718e3161351 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:02.970825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:02.971441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:02.971803 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:02.972032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:02.981424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:02.982910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:02.994450 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1357/2725] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:54:03.022427 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe776bad63b4c6193bcc0ef41f4bb9c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.029478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe776bad63b4c6193bcc0ef41f4bb9c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.037843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe776bad63b4c6193bcc0ef41f4bb9c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.038932 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe776bad63b4c6193bcc0ef41f4bb9c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.052185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1ec7181f-bbea-4838-9143-d8e7e6c93119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe776bad63b4c6193bcc0ef41f4bb9c'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.058651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1369/2726] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:02 2022] DELETE /identity/v3/users/fbe776bad63b4c6193bcc0ef41f4bb9c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:03.382414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:03.396488 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3808bd-61b2-4869-801d-7532449103bf service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:03.482572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:03.483501 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:03.483780 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:03.484079 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] PATH_INFO: `/v3/projects/4c429bf63b594721b10a0e3de8411ffb` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:03.485206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c429bf63b594721b10a0e3de8411ffb)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:03.487145 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:03.518659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:03.539229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c429bf63b594721b10a0e3de8411ffb', 'request_id': 'req-80ac0e29-1114-4fda-b976-23e145c26f08'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.545790 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c429bf63b594721b10a0e3de8411ffb', 'request_id': 'req-80ac0e29-1114-4fda-b976-23e145c26f08'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.552610 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c429bf63b594721b10a0e3de8411ffb', 'request_id': 'req-80ac0e29-1114-4fda-b976-23e145c26f08'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.565691 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] The token cache is being invalidate because project 4c429bf63b594721b10a0e3de8411ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:03.565965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.566580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-80ac0e29-1114-4fda-b976-23e145c26f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:03.568098 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1358/2727] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:03 2022] DELETE /identity/v3/projects/4c429bf63b594721b10a0e3de8411ffb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:03.572948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:03.573252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:03.573531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:03.592808 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:03.594042 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:03.678133 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1370/2728] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:03.686082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:03.686651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:03.686990 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:03.712452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:03.713693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:03.730101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1359/2729] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:03.732999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:03.750361 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c71d-ce16-4ec8-8cdc-9e8414a9c542 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:03.757058 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:03.757687 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:03.757976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:03.758234 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:03.759115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:54:03.759424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:03.761478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:03.781846 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1371/2730] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:54:03.782713 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:03.794724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67fa4c-27b0-471b-aee9-57b7c9fbb74e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:03.809991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:03.810620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:03.810887 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:03.811195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:03.811799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:03.814157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:03.859884 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1360/2731] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:03 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:54:03.863849 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:03.878717 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bbf93-2ca9-47ab-8ba4-304292030f42 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:03.948979 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:03.965140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:03.965844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:03.966365 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:03.966550 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:03.969976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:03.980166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:04.014001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1372/2732] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:03 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:04.015977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:04.030337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a267-3cac-418c-9108-94b7155b45ab admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:04.036674 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:04.037378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:04.037378 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:04.037563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:04.038216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:04.039974 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:04.050773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1361/2733] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:04.054663 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:04.066651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881517d7-24d9-414a-846c-7c8735a60746 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:04.072257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd153cf6-6549-423a-ad6d-aa551a2617a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:04.072947 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd153cf6-6549-423a-ad6d-aa551a2617a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:04.073293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd153cf6-6549-423a-ad6d-aa551a2617a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:04.073659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd153cf6-6549-423a-ad6d-aa551a2617a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:04.074379 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd153cf6-6549-423a-ad6d-aa551a2617a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:04.076128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd153cf6-6549-423a-ad6d-aa551a2617a2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:04.089235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1373/2734] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:04.095481 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:04.114467 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981e64d-a470-44c0-b63b-dfaa4550c1c6 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:04.123308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:04.124251 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:04.125054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:04.125368 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] PATH_INFO: `/v3/projects/5067586e3b92482eb222d42874a973e6/users/a298fea0168e40e1ad58f6501f039db3/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:04.143086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5067586e3b92482eb222d42874a973e6, user_id=a298fea0168e40e1ad58f6501f039db3, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:04.145736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:04.160188 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1362/2735] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:04 2022] PUT /identity/v3/projects/5067586e3b92482eb222d42874a973e6/users/a298fea0168e40e1ad58f6501f039db3/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:04.166209 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:04.166478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:04.166774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:04.189719 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:04.192109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:04.271881 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1374/2736] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:04.282255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:04.284134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:04.350776 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be05229-cf69-4451-bb14-7b07b97f7961 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:04.355432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e3e21c-ef9e-4d22-965f-f7bfcddf01f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:04.355552 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e21c-ef9e-4d22-965f-f7bfcddf01f3 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:04.356017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e21c-ef9e-4d22-965f-f7bfcddf01f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:04.356381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e3e21c-ef9e-4d22-965f-f7bfcddf01f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:04.368377 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3e21c-ef9e-4d22-965f-f7bfcddf01f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:04.370032 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e3e21c-ef9e-4d22-965f-f7bfcddf01f3 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:04.383039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1363/2737] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:05.051310 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.053468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.071274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c764e-d245-4a11-8e05-9f085bf098b2 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.083772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.084986 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.085270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.085544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] PATH_INFO: `/v3/users/97a06a5aa4164bbaad91a60b9d9a0a7e` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.093414 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a06a5aa4164bbaad91a60b9d9a0a7e)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.095424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.180074 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.180664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.181182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.187798 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a06a5aa4164bbaad91a60b9d9a0a7e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:05.208815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a06a5aa4164bbaad91a60b9d9a0a7e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:05.221430 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a06a5aa4164bbaad91a60b9d9a0a7e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:05.223019 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a06a5aa4164bbaad91a60b9d9a0a7e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:05.224007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] MFA Rules not processed for user `a298fea0168e40e1ad58f6501f039db3`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:05.226348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.242910 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-1d9576ea-3ab1-4da5-b865-5575a12a1598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a06a5aa4164bbaad91a60b9d9a0a7e'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:05.258622 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1375/2738] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:05 2022] DELETE /identity/v3/users/97a06a5aa4164bbaad91a60b9d9a0a7e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:05.261022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.261534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.262014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.288007 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:05.289404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.299980 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:05.333903 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1364/2739] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:05.339111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.341387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.358167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:05.375596 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9503b7-b985-4d63-bc89-fe272981aa7e None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.386753 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1376/2740] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:05.392184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.392835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.393136 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.393440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.394416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.396659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.402623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.404207 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.446394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1365/2741] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:05 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:54:05.450489 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.473546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd438f37-3eb2-4661-ace0-249eeae17f79 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.532885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09589b4e-7eb1-4e60-93dc-6e609292b0b1 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.537089 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.537656 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.537928 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.538193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.538602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.539346 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.540282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.540282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.541126 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.545651 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.556711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.558181 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.578353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1366/2742] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:05 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:05.579832 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.599143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1377/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:05.600017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a97b6-c20e-4706-801b-16b2390cc36b admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.605975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a7d88-9176-4605-8d9b-c37b469fbf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.607561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7d88-9176-4605-8d9b-c37b469fbf55 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.607561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7d88-9176-4605-8d9b-c37b469fbf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.607561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a7d88-9176-4605-8d9b-c37b469fbf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.608181 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7d88-9176-4605-8d9b-c37b469fbf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.610636 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a7d88-9176-4605-8d9b-c37b469fbf55 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.624757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1367/2744] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:05.629203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.642950 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555b663-cdf0-4bb5-8d46-bb5247b87a3b service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.649145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.650167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.650627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.650931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] PATH_INFO: `/v3/projects/869da9da6a8549cb883c67b210478f81/users/d5bfe6bea616424eb4523ef090234da3/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.653768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.654102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.654483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.677293 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=869da9da6a8549cb883c67b210478f81, user_id=d5bfe6bea616424eb4523ef090234da3, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.682329 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.688568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:05.689817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.707888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1378/2745] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:05 2022] PUT /identity/v3/projects/869da9da6a8549cb883c67b210478f81/users/d5bfe6bea616424eb4523ef090234da3/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:05.710768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1368/2746] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:05.712358 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.736551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.738545 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:05.866379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e118aa-01b4-454c-9848-c2a38aac7adb None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.896681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6156b-bd6e-4dc9-8de7-f09b4f37ceaf admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.911471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.912114 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.912398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.912675 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:05.913342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:05.915495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:05.942876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:05.948106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1379/2747] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:05.950500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:05.980212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b572c6-9556-42f0-8e57-2e67947dd3b4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:05.996315 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:05.997003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:05.997284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:05.997722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] PATH_INFO: `/v3/projects/869da9da6a8549cb883c67b210478f81/users/d5bfe6bea616424eb4523ef090234da3/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:06.000130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869da9da6a8549cb883c67b210478f81, user_id=d5bfe6bea616424eb4523ef090234da3, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:06.007452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:06.040438 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1380/2748] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:05 2022] PUT /identity/v3/projects/869da9da6a8549cb883c67b210478f81/users/d5bfe6bea616424eb4523ef090234da3/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:06.045226 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:06.046555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:06.046897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:06.047174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:06.059436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:06.061201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:06.081511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1369/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:06.208243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:06.210468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:06.244845 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:06.350557 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947aeec9-5ea9-4d11-a9c5-e0866ab96bd3 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:06.368031 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:06.371140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:06.371517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:06.372010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] PATH_INFO: `/v3/projects/08fe253035a142c99c753fd6adcb1555` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:06.375469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08fe253035a142c99c753fd6adcb1555)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:06.382754 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:06.482056 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08fe253035a142c99c753fd6adcb1555', 'request_id': 'req-e117c005-12b1-41d5-8dce-98e2a2efb9bc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.497434 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08fe253035a142c99c753fd6adcb1555', 'request_id': 'req-e117c005-12b1-41d5-8dce-98e2a2efb9bc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.510961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08fe253035a142c99c753fd6adcb1555', 'request_id': 'req-e117c005-12b1-41d5-8dce-98e2a2efb9bc'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.537989 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] The token cache is being invalidate because project 08fe253035a142c99c753fd6adcb1555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:06.538185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.539558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e117c005-12b1-41d5-8dce-98e2a2efb9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.544411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1381/2750] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:06 2022] DELETE /identity/v3/projects/08fe253035a142c99c753fd6adcb1555 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:06.548792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:06.562717 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463639-429d-4fd1-8d1a-d905cfc83807 service nova] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:06.688991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:06.689702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:06.689988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:06.690263 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] PATH_INFO: `/v3/users/759ccf468a1e4e4aab25beeed56e2d35` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:06.692219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759ccf468a1e4e4aab25beeed56e2d35)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:06.694950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:06.811475 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759ccf468a1e4e4aab25beeed56e2d35'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.831429 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759ccf468a1e4e4aab25beeed56e2d35'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.843338 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759ccf468a1e4e4aab25beeed56e2d35'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.844702 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759ccf468a1e4e4aab25beeed56e2d35'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.870788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759ccf468a1e4e4aab25beeed56e2d35'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:06.878130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1370/2751] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:06 2022] DELETE /identity/v3/users/759ccf468a1e4e4aab25beeed56e2d35 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:07.284100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76db81-4a66-44ac-9a4d-f0ae58cb7468 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:07.284586 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76db81-4a66-44ac-9a4d-f0ae58cb7468 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:07.284681 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76db81-4a66-44ac-9a4d-f0ae58cb7468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:07.360279 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-8d76db81-4a66-44ac-9a4d-f0ae58cb7468 None None] MFA Rules not processed for user `d5bfe6bea616424eb4523ef090234da3`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:07.361678 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-8d76db81-4a66-44ac-9a4d-f0ae58cb7468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:07.446767 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:07.448666 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:07.508899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:07.560355 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1382/2752] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:07.572983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:07.573338 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:07.573519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:07.583101 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c3a9-2873-48ef-97f8-dbfaffc295d7 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:07.590671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:07.591746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:07.593819 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:07.594764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] PATH_INFO: `/v3/projects/5939c212f3c34ecb9c611302fa4382f3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:07.597031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5939c212f3c34ecb9c611302fa4382f3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:07.600632 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:07.605703 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] MFA Rules not processed for user `a298fea0168e40e1ad58f6501f039db3`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:07.607466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:07.632502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:07.702177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1383/2753] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:07.704648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5939c212f3c34ecb9c611302fa4382f3', 'request_id': 'req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:07.720574 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:07.722484 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:07.723716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5939c212f3c34ecb9c611302fa4382f3', 'request_id': 'req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:07.739808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5939c212f3c34ecb9c611302fa4382f3', 'request_id': 'req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:07.784420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] The token cache is being invalidate because project 5939c212f3c34ecb9c611302fa4382f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:07.785344 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:07.786025 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-4d3e826d-8c89-4ddb-9f1e-9b3572756d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:07.794171 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1371/2754] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:07 2022] DELETE /identity/v3/projects/5939c212f3c34ecb9c611302fa4382f3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:07.795620 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3736-ab64-4f98-8cb3-8b461abaf849 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:07.795902 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3736-ab64-4f98-8cb3-8b461abaf849 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:07.796183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d3736-ab64-4f98-8cb3-8b461abaf849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:07.830739 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f05d3736-ab64-4f98-8cb3-8b461abaf849 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:07.832533 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f05d3736-ab64-4f98-8cb3-8b461abaf849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:07.842439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62909ea1-28f5-4eb2-8c1e-92c740b45bdd None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:07.940269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1372/2755] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:07.948380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:07.948775 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:07.948952 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:07.950122 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:07.950780 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:07.951059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:07.951323 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:07.953490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:07.988015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:07.989239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:08.002537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1373/2756] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:08.007311 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.019067 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b15e8-2419-499c-b503-1f26976643bb None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.024737 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.025410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.025736 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.026007 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.026768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:54:08.027069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.028744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.048766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1374/2757] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:54:08.054494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.070369 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760de7e-23c9-4df0-8c20-5109ecc42502 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.073833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.075782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32663308-fc9f-4179-9c0b-1e586751991e service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.076143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.076751 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.077348 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.077671 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.078304 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.080283 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.087091 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1384/2758] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:08.088192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.088478 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.088747 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.096874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:08.131844 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] MFA Rules not processed for user `507f5b173f924cb89d001a317c0ce0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:08.133744 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:08.145503 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1375/2759] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:54:08.149558 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.201807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:08.224081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1385/2760] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:08.229878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.233948 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:08.250202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1ccf3-dce8-4227-bdf5-a7db857ff800 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.257182 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ca7d1-2a1a-415c-8d49-01efdaff02b0 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.258344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.259118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.259490 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.260384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.261106 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.262658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.266768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.268799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.269418 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.269838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.271269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.273539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.314301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1376/2761] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:54:08.314466 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1386/2762] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:08.318828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.319539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.338712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d21cf7-b554-4c93-a129-1a86c27b7f5f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.445878 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1380a-b6b2-4ea1-880f-f20ecfea47a5 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.451659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.452290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.452768 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.453043 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.453707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.455886 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.456890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.457582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.458036 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.458367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.459121 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.461465 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.484204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1377/2763] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:08.485255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.496583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1387/2764] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:08.500638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.510742 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a89f2-35c0-4c7e-819d-76a6e67f647a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.517976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.519054 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.519604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.520192 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.521031 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.523335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.525888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ecd16-cd70-4d6b-b7f2-ebee02772092 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.534191 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.535132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.535132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.535395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.536049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.537671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.544568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1378/2765] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:08.546719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.552322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1388/2766] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:08.557109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.559555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e565a2-e6c4-4b94-94dd-8d024118f740 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.565165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e221ac-d426-4486-b02e-1e3dd909e375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.566258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e221ac-d426-4486-b02e-1e3dd909e375 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.567413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e221ac-d426-4486-b02e-1e3dd909e375 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.567923 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e221ac-d426-4486-b02e-1e3dd909e375 admin admin] PATH_INFO: `/v3/projects/d3109d812c4044d5b39d96718625aa59/users/89ceae10607a41ea9549430698116366/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.577168 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ea68a-4a29-477b-b590-c86d75f850e0 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.583648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.585318 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.585606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.585888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] PATH_INFO: `/v3/projects/c055e95469224926af24397b1134942b/users/9dfad83c34fe4574b131adfe1b6a2234/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.593461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e221ac-d426-4486-b02e-1e3dd909e375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3109d812c4044d5b39d96718625aa59, user_id=89ceae10607a41ea9549430698116366, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.597792 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e221ac-d426-4486-b02e-1e3dd909e375 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.607249 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c055e95469224926af24397b1134942b, user_id=9dfad83c34fe4574b131adfe1b6a2234, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.611446 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.621635 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1379/2767] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:08 2022] PUT /identity/v3/projects/d3109d812c4044d5b39d96718625aa59/users/89ceae10607a41ea9549430698116366/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:08.632559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1389/2768] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:08 2022] PUT /identity/v3/projects/c055e95469224926af24397b1134942b/users/9dfad83c34fe4574b131adfe1b6a2234/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:08.633475 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.634519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.634519 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.634754 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.662212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:08.675197 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] MFA Rules not processed for user `89ceae10607a41ea9549430698116366`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:08.677814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:08.701129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776b5fe-94c6-41f7-bed8-8c111d1277c4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.706111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.706761 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.707109 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.707384 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.708178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.710020 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.726598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1390/2769] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:08.727542 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.740984 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d868c-8736-4cc8-bc16-9c26c6cf9f03 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.752752 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29b1e3-9b3a-41f9-bf7f-a1a15be86626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:08.753435 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b1e3-9b3a-41f9-bf7f-a1a15be86626 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.753714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b1e3-9b3a-41f9-bf7f-a1a15be86626 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.753983 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b1e3-9b3a-41f9-bf7f-a1a15be86626 admin admin] PATH_INFO: `/v3/projects/c055e95469224926af24397b1134942b/users/9dfad83c34fe4574b131adfe1b6a2234/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.760078 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29b1e3-9b3a-41f9-bf7f-a1a15be86626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c055e95469224926af24397b1134942b, user_id=9dfad83c34fe4574b131adfe1b6a2234, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:08.763793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29b1e3-9b3a-41f9-bf7f-a1a15be86626 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:08.779387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1380/2770] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:08.794583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1391/2771] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:08 2022] PUT /identity/v3/projects/c055e95469224926af24397b1134942b/users/9dfad83c34fe4574b131adfe1b6a2234/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:08.818540 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:08.820276 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:08.829424 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:08.905617 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d12d8d-2f9c-4178-9bcb-d17d13024474 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:08.915732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:08.916011 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:08.916278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:08.947463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:08.956971 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:09.023210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:09.024375 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:09.024659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:09.024933 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:09.047118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1392/2772] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:09.070982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:09.072482 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:09.125627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:09.128527 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:09.143002 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1381/2773] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:09.159229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:09.176054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf304b-86c1-4dcf-b759-ca1ee925f344 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:09.182340 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3150-4da9-43e2-a578-8b5d7de2a964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:09.183000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3150-4da9-43e2-a578-8b5d7de2a964 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:09.183275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3150-4da9-43e2-a578-8b5d7de2a964 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:09.183548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3150-4da9-43e2-a578-8b5d7de2a964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:09.184044 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c175f-7259-4a27-bfcc-c0e9edcb9e95 service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:09.191233 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:09.192528 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:09.192800 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3150-4da9-43e2-a578-8b5d7de2a964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:09.192922 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:09.193777 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] PATH_INFO: `/v3/users/89ceae10607a41ea9549430698116366` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:09.194646 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3150-4da9-43e2-a578-8b5d7de2a964 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:09.195135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ceae10607a41ea9549430698116366)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:09.197482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:09.214545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1393/2774] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:09.268417 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ceae10607a41ea9549430698116366'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:09.279667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ceae10607a41ea9549430698116366'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:09.288514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ceae10607a41ea9549430698116366'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:09.289401 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ceae10607a41ea9549430698116366'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:09.309180 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:09.343572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ceae10607a41ea9549430698116366'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:09.355513 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1382/2775] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:09 2022] DELETE /identity/v3/users/89ceae10607a41ea9549430698116366 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:09.361635 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:09.363022 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:09.363558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:09.413222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:09.414599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:09.448548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:09.483381 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1394/2776] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:09.493333 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:09.494804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:09.555778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2bf54-a7cc-4bb8-989b-d5d83c156a39 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:09.559621 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a74c90d-99ae-4dc6-95fd-d94489700384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:09.560652 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74c90d-99ae-4dc6-95fd-d94489700384 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:09.560932 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74c90d-99ae-4dc6-95fd-d94489700384 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:09.561204 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a74c90d-99ae-4dc6-95fd-d94489700384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:09.571357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74c90d-99ae-4dc6-95fd-d94489700384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:09.572796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a74c90d-99ae-4dc6-95fd-d94489700384 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:09.584950 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1383/2777] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:09.907941 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:09.909708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:09.927075 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b9ef4-fe28-4ff5-80d4-e00861616c09 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:09.940501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:09.941309 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:09.941537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:09.941889 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] PATH_INFO: `/v3/projects/d3109d812c4044d5b39d96718625aa59` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:09.943413 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3109d812c4044d5b39d96718625aa59)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:09.946538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.060211 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3109d812c4044d5b39d96718625aa59', 'request_id': 'req-7d0f8b02-7fde-404b-8094-6e10d9843023'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:10.079870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3109d812c4044d5b39d96718625aa59', 'request_id': 'req-7d0f8b02-7fde-404b-8094-6e10d9843023'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:10.086591 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3109d812c4044d5b39d96718625aa59', 'request_id': 'req-7d0f8b02-7fde-404b-8094-6e10d9843023'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:10.112736 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] The token cache is being invalidate because project d3109d812c4044d5b39d96718625aa59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:10.113029 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:10.113709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-7d0f8b02-7fde-404b-8094-6e10d9843023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:10.115496 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1395/2778] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:09 2022] DELETE /identity/v3/projects/d3109d812c4044d5b39d96718625aa59 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:10.120320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.120788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.121122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.142653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:10.144319 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:10.246906 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1384/2779] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:10.255224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.255769 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.256188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.285543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:10.287383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:10.300647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1396/2780] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:10.304076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.320130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208dfd7-80e6-43af-98ee-9385d6de6250 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.328222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.329081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.329506 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.329939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.330838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:54:10.331434 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.333387 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.350046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1385/2781] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:54:10.354741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.365415 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1ecbf-69ba-43fd-8147-e2afb84e871d None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.370463 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.371097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.371639 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.371908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.372534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.374528 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.407152 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1397/2782] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:10 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:10.411353 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.424810 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c631f2e-344e-4d11-87d5-40f6cb3c8525 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.499581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.500097 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.500374 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.501004 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.501279 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.503242 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.531509 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1386/2783] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:10 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:54:10.532077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.544661 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b8295-50b3-4588-b545-c149e9f81c5b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.550401 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.551128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.551432 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.551712 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.552341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.554161 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.566392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1398/2784] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 10:54:10.570871 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.581764 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7bec2-f3f5-402b-979e-3cb11d5913db admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.586816 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b5874-ef75-4adf-8162-2f7a32f2084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.587431 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5874-ef75-4adf-8162-2f7a32f2084c admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.587727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5874-ef75-4adf-8162-2f7a32f2084c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.588015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b5874-ef75-4adf-8162-2f7a32f2084c admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.588667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5874-ef75-4adf-8162-2f7a32f2084c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.590409 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b5874-ef75-4adf-8162-2f7a32f2084c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.593482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:10.611847 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1387/2785] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:10.613105 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.624123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6334-699c-4b40-9d94-8dec462b9a9f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.630267 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.631157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.631369 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.631637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] PATH_INFO: `/v3/projects/6b544178c9b645f49c962672579e7f46/users/5d5a44ee1c844b128ef63ce4fce01eab/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.650028 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b544178c9b645f49c962672579e7f46, user_id=5d5a44ee1c844b128ef63ce4fce01eab, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.652981 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.670817 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1399/2786] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:10 2022] PUT /identity/v3/projects/6b544178c9b645f49c962672579e7f46/users/5d5a44ee1c844b128ef63ce4fce01eab/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:54:10.679582 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78d1d-0fe7-4175-ac3b-64b7f2875138 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.679831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78d1d-0fe7-4175-ac3b-64b7f2875138 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.680206 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78d1d-0fe7-4175-ac3b-64b7f2875138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.718324 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-fbd78d1d-0fe7-4175-ac3b-64b7f2875138 None None] MFA Rules not processed for user `5d5a44ee1c844b128ef63ce4fce01eab`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:10.720841 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-fbd78d1d-0fe7-4175-ac3b-64b7f2875138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:10.824157 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1388/2787] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:10.836015 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:10.838111 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:10.902870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5bc6-929b-456c-8915-43f17625f4a8 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:10.907344 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:10.908197 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:10.908543 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:10.908883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:10.916931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:10.921392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:10.923833 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:10.937138 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1400/2788] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:15.418445 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe477c3-6ff4-4a6b-a9f7-c6a7d2e939dd None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:15.419416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe477c3-6ff4-4a6b-a9f7-c6a7d2e939dd None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:15.419683 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe477c3-6ff4-4a6b-a9f7-c6a7d2e939dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:15.452629 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1fe477c3-6ff4-4a6b-a9f7-c6a7d2e939dd None None] MFA Rules not processed for user `9dfad83c34fe4574b131adfe1b6a2234`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:15.453959 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1fe477c3-6ff4-4a6b-a9f7-c6a7d2e939dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:15.528000 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1389/2789] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:15.541804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:15.543282 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:15.554810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb32152-c2f3-4827-9fb2-33e64d1627a4 service glance] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:15.559185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:15.559796 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:15.560068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:15.560426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:15.562614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:15.636610 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:15.638046 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:15.647902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1401/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:15.779255 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:15.779565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:15.779826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:15.801517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:15.802783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:15.862485 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1390/2791] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:15.912549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:15.914099 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:15.988657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80906b5c-6e3d-4867-8e1b-245c34bbe346 service glance] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:15.993909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ff0a8-79d7-4aec-b50b-290abe36a20e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:15.994534 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff0a8-79d7-4aec-b50b-290abe36a20e service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:15.994843 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff0a8-79d7-4aec-b50b-290abe36a20e service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:15.995113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ff0a8-79d7-4aec-b50b-290abe36a20e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:16.006049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ff0a8-79d7-4aec-b50b-290abe36a20e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:16.007722 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ff0a8-79d7-4aec-b50b-290abe36a20e service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:16.017793 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1402/2792] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:54:19.932724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:19.934988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:19.962910 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:20.076205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316699c-e3e8-4246-b0b5-929b01409f61 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:20.084581 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:20.085210 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:20.085484 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:20.085750 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:20.087539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:20.101048 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:20.102949 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4cd60-1a2f-4602-80b3-2b1ff4f0121c service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:20.120138 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1391/2793] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:25.662383 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:25.662917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:25.663035 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:25.691202 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] MFA Rules not processed for user `75eb365788c1489aa6119a3e21fd1c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:25.692471 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:25.780363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1403/2794] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:25.926605 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc71958-bce2-400f-8f29-d95d1f66a310 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:25.927199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc71958-bce2-400f-8f29-d95d1f66a310 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:25.927199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc71958-bce2-400f-8f29-d95d1f66a310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:25.950024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-cbc71958-bce2-400f-8f29-d95d1f66a310 None None] MFA Rules not processed for user `507f5b173f924cb89d001a317c0ce0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:25.951280 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-cbc71958-bce2-400f-8f29-d95d1f66a310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:25.959070 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1392/2795] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:26.240577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:26.242347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:26.279439 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:26.313917 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b9a95-77c3-4dba-9f56-8d16e2873438 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:26.318157 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:26.318855 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:26.319219 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:26.319567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:26.321545 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:26.334183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:26.336160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:26.357887 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1404/2796] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:29.185371 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:29.185898 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:29.186039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:29.211148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:29.212385 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:29.224041 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1393/2797] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:29.242186 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:29.257193 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a6360-e3e5-48e8-951d-fdf9c3545699 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:29.263807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:29.264856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:29.265286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:29.265629 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:29.275457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:29.278148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:29.288236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1405/2798] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:54:30.118381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:30.119844 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:30.239807 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abefe3e-ff2a-42e6-987b-2d9c125dfc53 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:30.244603 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:30.245534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:30.246129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:30.246733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:30.249716 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:30.468679 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:30.475483 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa1d55c-4ece-46bd-a4b2-afb53b2834f9 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:30.503534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1394/2799] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:33.580685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:33.648907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0651a2-3877-4cec-82d2-133611b76655 service swift] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:33.659271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:33.659964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:33.660246 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:33.660512 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] PATH_INFO: `/v3/users/5d5a44ee1c844b128ef63ce4fce01eab` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:33.661679 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5a44ee1c844b128ef63ce4fce01eab)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:33.663922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:33.718852 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5a44ee1c844b128ef63ce4fce01eab'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:33.727301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5a44ee1c844b128ef63ce4fce01eab'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:33.738495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5a44ee1c844b128ef63ce4fce01eab'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:33.739153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5a44ee1c844b128ef63ce4fce01eab'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:33.758404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5a44ee1c844b128ef63ce4fce01eab'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:33.765573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1406/2800] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:33 2022] DELETE /identity/v3/users/5d5a44ee1c844b128ef63ce4fce01eab => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:33.770848 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:33.771471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:33.771471 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:33.792124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:33.793332 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:33.837455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=100 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:33.872213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1395/2801] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:33.887516 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:33.889038 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:33.949888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:33.976803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b800f-8866-4efc-a708-f011c102ce17 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:33.980682 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef932c6b-9002-4d7b-846e-a8181dedd118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:33.991472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef932c6b-9002-4d7b-846e-a8181dedd118 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:33.991472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef932c6b-9002-4d7b-846e-a8181dedd118 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:33.991709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef932c6b-9002-4d7b-846e-a8181dedd118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.003472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef932c6b-9002-4d7b-846e-a8181dedd118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:34.005162 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef932c6b-9002-4d7b-846e-a8181dedd118 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:34.024158 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1407/2802] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:34.468565 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:34.470095 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:34.482578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc216c-836b-4762-be07-a85caddf8ee3 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:34.487627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:34.488302 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:34.488734 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:34.489005 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] PATH_INFO: `/v3/projects/6b544178c9b645f49c962672579e7f46` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.490209 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b544178c9b645f49c962672579e7f46)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:34.492403 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:34.549461 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b544178c9b645f49c962672579e7f46', 'request_id': 'req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:34.556499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b544178c9b645f49c962672579e7f46', 'request_id': 'req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:34.565452 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b544178c9b645f49c962672579e7f46', 'request_id': 'req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:34.581045 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] The token cache is being invalidate because project 6b544178c9b645f49c962672579e7f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:34.581579 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:34.582232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-e78f1af5-4ed1-4c1f-801c-79a6e8e424f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:34.586766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1396/2803] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:34 2022] DELETE /identity/v3/projects/6b544178c9b645f49c962672579e7f46 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:34.588964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:34.589456 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:34.589548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.609771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:34.611021 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:34.672155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1408/2804] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:34.742988 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:34.743272 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:34.743549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.763604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:34.764876 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:34.773449 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1397/2805] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:34.777694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:34.787931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bf5f5-ec6c-4dfa-ba04-21d6e635d45b None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:34.792735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:34.793350 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:34.793628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:34.793936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.794548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:54:34.794885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:34.796630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:34.809129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1409/2806] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:54:34.813727 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:34.824925 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e2908-53b4-4f1b-8305-d299f9b6918f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:34.830111 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:34.833260 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:34.833554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:34.834809 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] PATH_INFO: `/v3/projects` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.835482 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:34.837410 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:34.872023 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1398/2807] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:34 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:34.880694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:34.886618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987f321-730c-4a86-938f-6ade7ffedbb2 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:34.955080 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:34.955795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:34.956195 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:34.956546 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] PATH_INFO: `/v3/users` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:34.957311 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:34.959570 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:35.003372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1410/2808] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:34 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:35.007616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:35.025765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da887851-99f6-48c5-bafc-333a9ec89366 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:35.035104 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:35.035685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:35.035966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:35.036243 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:35.036915 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:35.038595 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:35.053039 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1399/2809] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:35.056706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:35.074239 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f06156-cb58-4937-b928-e8b8d41afe54 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:35.079212 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0875-de01-410e-8848-e0e3ef93eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:35.079892 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0875-de01-410e-8848-e0e3ef93eb82 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:35.080228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0875-de01-410e-8848-e0e3ef93eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:35.080560 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0875-de01-410e-8848-e0e3ef93eb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:35.081270 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0875-de01-410e-8848-e0e3ef93eb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:35.082961 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0875-de01-410e-8848-e0e3ef93eb82 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:35.098723 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1411/2810] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:35.099687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:35.110356 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79591b51-27a6-4f4e-bfc7-a2f1bf0ddf8e admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:35.115211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:35.115885 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:35.116166 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:35.116914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] PATH_INFO: `/v3/projects/27eef1b92d4640bba5d4247c7ba98f84/users/69e7009e75e44d84bd33f775c8a4b71f/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:35.136935 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27eef1b92d4640bba5d4247c7ba98f84, user_id=69e7009e75e44d84bd33f775c8a4b71f, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:35.140086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:35.162799 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1400/2811] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:35 2022] PUT /identity/v3/projects/27eef1b92d4640bba5d4247c7ba98f84/users/69e7009e75e44d84bd33f775c8a4b71f/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:35.173018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:35.173377 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:35.173706 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:35.242804 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] MFA Rules not processed for user `69e7009e75e44d84bd33f775c8a4b71f`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:35.244188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:35.349746 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:35.424036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1412/2812] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:35.435659 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:35.437833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:35.574766 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88098353-4929-479a-ba95-b5e593699191 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:35.582223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5455e3f-bfab-4c4a-a13f-193afa1e16e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:35.583228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455e3f-bfab-4c4a-a13f-193afa1e16e3 service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:35.583787 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455e3f-bfab-4c4a-a13f-193afa1e16e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:35.584270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5455e3f-bfab-4c4a-a13f-193afa1e16e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:35.596265 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455e3f-bfab-4c4a-a13f-193afa1e16e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:35.599631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5455e3f-bfab-4c4a-a13f-193afa1e16e3 service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:35.606865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:35.613365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1401/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:54:45.412733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=11 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:45.861577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:45.929221 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a36b6-3f46-4f55-872a-702c45d30080 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:45.933875 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:45.934507 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:45.934813 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:45.935090 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] PATH_INFO: `/v3/users/69e7009e75e44d84bd33f775c8a4b71f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:45.936224 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69e7009e75e44d84bd33f775c8a4b71f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:45.938137 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:45.992870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69e7009e75e44d84bd33f775c8a4b71f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:45.999854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69e7009e75e44d84bd33f775c8a4b71f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.014671 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69e7009e75e44d84bd33f775c8a4b71f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.015450 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69e7009e75e44d84bd33f775c8a4b71f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.028641 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69e7009e75e44d84bd33f775c8a4b71f'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.036378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1413/2814] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:45 2022] DELETE /identity/v3/users/69e7009e75e44d84bd33f775c8a4b71f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:46.040746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:46.041246 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:46.041360 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:46.061247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:46.062535 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:46.122085 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1402/2815] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:46.131856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:46.133290 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:46.190868 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198cc4d-2f75-4512-9c40-6b9d4d073316 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:46.194872 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef69f1c-b735-49b7-98fe-ddf4fda21897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:46.195480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef69f1c-b735-49b7-98fe-ddf4fda21897 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:46.195755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef69f1c-b735-49b7-98fe-ddf4fda21897 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:46.196036 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef69f1c-b735-49b7-98fe-ddf4fda21897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:46.205335 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef69f1c-b735-49b7-98fe-ddf4fda21897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:46.206825 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef69f1c-b735-49b7-98fe-ddf4fda21897 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:46.216322 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1414/2816] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:46.580720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:46.582336 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:46.606142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9831ae-eec8-43e5-ad59-d287b07fb1da None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:46.612441 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:46.614148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:46.614690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:46.615305 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] PATH_INFO: `/v3/projects/27eef1b92d4640bba5d4247c7ba98f84` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:46.617616 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=27eef1b92d4640bba5d4247c7ba98f84)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:46.620686 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:46.683230 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27eef1b92d4640bba5d4247c7ba98f84', 'request_id': 'req-47572e33-fbe3-47ea-b737-8e152eaa9e9c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.692038 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27eef1b92d4640bba5d4247c7ba98f84', 'request_id': 'req-47572e33-fbe3-47ea-b737-8e152eaa9e9c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.700065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27eef1b92d4640bba5d4247c7ba98f84', 'request_id': 'req-47572e33-fbe3-47ea-b737-8e152eaa9e9c'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.712992 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] The token cache is being invalidate because project 27eef1b92d4640bba5d4247c7ba98f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93274) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:46.713281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.714009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:46.715547 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1403/2817] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:46 2022] DELETE /identity/v3/projects/27eef1b92d4640bba5d4247c7ba98f84 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:49.754167 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d59fc-30c0-42e4-9c80-5907c2a65bc4 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:49.754782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d59fc-30c0-42e4-9c80-5907c2a65bc4 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:49.754782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d59fc-30c0-42e4-9c80-5907c2a65bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:49.777275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-5c9d59fc-30c0-42e4-9c80-5907c2a65bc4 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:49.778577 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5c9d59fc-30c0-42e4-9c80-5907c2a65bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:49.798726 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:49.844912 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1415/2818] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:49.900141 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:49.902984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:49.984174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47572e33-fbe3-47ea-b737-8e152eaa9e9c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:49.990167 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:49.990826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:49.991108 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:49.991383 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:49.999879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:50.001494 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:50.011120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1404/2819] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:52.833130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:52.833707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:52.833707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:52.854039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:52.855261 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:52.864544 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1416/2820] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:52.891003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:52.903200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c5a98-0209-4d38-9e60-68c06ec2e565 service nova] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:52.910143 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5896bd14-4323-4da5-b9de-d479418aa3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:52.910730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896bd14-4323-4da5-b9de-d479418aa3c9 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:52.911015 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896bd14-4323-4da5-b9de-d479418aa3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:52.911284 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5896bd14-4323-4da5-b9de-d479418aa3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:52.917622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:52.920107 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896bd14-4323-4da5-b9de-d479418aa3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:52.922003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5896bd14-4323-4da5-b9de-d479418aa3c9 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:52.932144 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1405/2821] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:54.063856 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:54.065582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:54.124268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4701-19f7-4874-a77a-5fb014f68b15 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:54.128123 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:54.128732 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:54.129008 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:54.129271 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:54.131136 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:54.204050 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:54.205492 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:54.216422 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1417/2822] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:55.987343 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:55.988396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:55.989685 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:56.048033 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:56.050195 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:56.060531 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1406/2823] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:56.082883 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:56.085001 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:56.100837 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7457-15a9-4ccf-93c5-3786ca74966b service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:56.113120 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:56.113931 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:56.114303 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:56.114579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:56.131630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:56.131630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:56.153583 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1418/2824] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:57.688575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:57.690156 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:57.709420 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400e21e-b4ee-445b-9e0d-6c059cb7c63f None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:57.721622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:57.722294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:57.723330 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:57.724062 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] PATH_INFO: `/v3/users/a298fea0168e40e1ad58f6501f039db3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:57.726082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a298fea0168e40e1ad58f6501f039db3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:57.730539 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:57.796301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a298fea0168e40e1ad58f6501f039db3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:57.807891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a298fea0168e40e1ad58f6501f039db3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:57.816017 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a298fea0168e40e1ad58f6501f039db3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:57.816697 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a298fea0168e40e1ad58f6501f039db3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:57.832793 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a298fea0168e40e1ad58f6501f039db3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:57.840977 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1407/2825] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:57 2022] DELETE /identity/v3/users/a298fea0168e40e1ad58f6501f039db3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:58.030502 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:58.044151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bb596-f54d-4202-8f02-90c45081faf6 service nova] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:58.103740 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=100 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:58.115118 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:58.115756 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.116032 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.116298 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] PATH_INFO: `/v3/projects/5067586e3b92482eb222d42874a973e6` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.117842 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5067586e3b92482eb222d42874a973e6)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:58.119816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:58.186994 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5067586e3b92482eb222d42874a973e6', 'request_id': 'req-ebffc8d9-c026-473d-828d-e7267f2b0aaf'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.194517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5067586e3b92482eb222d42874a973e6', 'request_id': 'req-ebffc8d9-c026-473d-828d-e7267f2b0aaf'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.201958 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5067586e3b92482eb222d42874a973e6', 'request_id': 'req-ebffc8d9-c026-473d-828d-e7267f2b0aaf'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.218709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] The token cache is being invalidate because project 5067586e3b92482eb222d42874a973e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:58.219387 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.220342 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.222762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1419/2826] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:58 2022] DELETE /identity/v3/projects/5067586e3b92482eb222d42874a973e6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:58.227172 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:58.228913 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:58.242788 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee1fff-f5fe-4d65-9ef8-f11c11e3bbc9 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:58.310637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:58.311389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.311768 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.312151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] PATH_INFO: `/v3/users/d5bfe6bea616424eb4523ef090234da3` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.314178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bfe6bea616424eb4523ef090234da3)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:58.318193 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:58.388931 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bfe6bea616424eb4523ef090234da3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.398072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bfe6bea616424eb4523ef090234da3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.406627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bfe6bea616424eb4523ef090234da3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.407504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bfe6bea616424eb4523ef090234da3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.409199 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:58.424436 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-8c23918a-1545-4160-ab28-e73623bc27dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bfe6bea616424eb4523ef090234da3'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.434664 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1408/2827] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:58 2022] DELETE /identity/v3/users/d5bfe6bea616424eb4523ef090234da3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:58.623834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:58.625561 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:58.648408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffc8d9-c026-473d-828d-e7267f2b0aaf admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:58.717978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:58.718885 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.719238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.719609 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] PATH_INFO: `/v3/projects/869da9da6a8549cb883c67b210478f81` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.720770 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] RBAC: Authorizing `identity:delete_project(project_id=869da9da6a8549cb883c67b210478f81)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:58.723408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:58.772083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869da9da6a8549cb883c67b210478f81', 'request_id': 'req-c90e8804-5f50-4f2f-a37d-50cb60da215a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.778060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869da9da6a8549cb883c67b210478f81', 'request_id': 'req-c90e8804-5f50-4f2f-a37d-50cb60da215a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.784964 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869da9da6a8549cb883c67b210478f81', 'request_id': 'req-c90e8804-5f50-4f2f-a37d-50cb60da215a'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.800068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] The token cache is being invalidate because project 869da9da6a8549cb883c67b210478f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:54:58.800391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.800995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-c90e8804-5f50-4f2f-a37d-50cb60da215a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:58.802559 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1420/2828] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:54:58 2022] DELETE /identity/v3/projects/869da9da6a8549cb883c67b210478f81 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:58.807728 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.808220 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.808315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.828687 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:58.829899 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:58.891502 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1409/2829] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:58.899733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.900013 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.900276 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.923440 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:58.924648 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:58.933493 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1421/2830] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:58.937761 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:58.947711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53987a-d3e5-4613-bb38-b3567747799d None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:58.952631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:58.953221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.953493 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.953758 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.954402 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:54:58.954708 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:58.956320 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:58.968022 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1410/2831] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:54:58.972579 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:58.982252 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa43dc1-d74a-40e4-90ae-e1ed7c485aec None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:58.987372 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:58.987999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:58.988278 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:58.988549 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:58.989375 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:58.991146 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:58.995865 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:59.023696 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1422/2832] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:54:58 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:59.028574 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.039398 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfe342-501f-4ab3-8201-0802997ed35c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.098168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.098660 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.099009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.099269 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.099901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.101880 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.125003 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1411/2833] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:54:59 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:54:59.129527 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.144268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81236e-4129-4243-9b04-b5d57700e30b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.150897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a0ad3-cb00-48bf-969f-2497d4e3fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.151519 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a0ad3-cb00-48bf-969f-2497d4e3fee0 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.151795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a0ad3-cb00-48bf-969f-2497d4e3fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.152066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a0ad3-cb00-48bf-969f-2497d4e3fee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.152880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a0ad3-cb00-48bf-969f-2497d4e3fee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.154785 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a0ad3-cb00-48bf-969f-2497d4e3fee0 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.166045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1423/2834] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:59.170073 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.180804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a7aa3-47eb-4d24-8250-87268e50af32 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.185554 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.186183 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.186568 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.186927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.187694 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.189203 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.189357 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.189530 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.189841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.200239 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1412/2835] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:54:59.204372 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.209922 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:59.211151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:59.214185 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aeb7f5-f37a-4a8b-aba3-a786a62cb94a admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.218930 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d87e09f-4d8f-422e-9992-26f3ceb65631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.219538 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1424/2836] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:59.219712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e09f-4d8f-422e-9992-26f3ceb65631 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.220055 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e09f-4d8f-422e-9992-26f3ceb65631 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.220308 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d87e09f-4d8f-422e-9992-26f3ceb65631 admin admin] PATH_INFO: `/v3/projects/7e2c3d86826a4baa97202010f2ee269e/users/ac74c3f94bad4e72aad0db5b2537d8db/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.235592 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87e09f-4d8f-422e-9992-26f3ceb65631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2c3d86826a4baa97202010f2ee269e, user_id=ac74c3f94bad4e72aad0db5b2537d8db, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.238366 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d87e09f-4d8f-422e-9992-26f3ceb65631 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.242392 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.243836 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:59.252078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1413/2837] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:54:59 2022] PUT /identity/v3/projects/7e2c3d86826a4baa97202010f2ee269e/users/ac74c3f94bad4e72aad0db5b2537d8db/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:54:59.263433 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.263720 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.263991 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.292221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] MFA Rules not processed for user `ac74c3f94bad4e72aad0db5b2537d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:59.293462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:59.303416 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:59.326286 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dddf5f-f60a-4fbb-8df4-ffaeb0aebb07 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.363001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1414/2838] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 10:54:59.374178 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.375604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:59.391284 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e502a-ebb7-4d06-bd1b-7df86aebb10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.391942 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e502a-ebb7-4d06-bd1b-7df86aebb10c service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.392220 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e502a-ebb7-4d06-bd1b-7df86aebb10c service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.392487 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e502a-ebb7-4d06-bd1b-7df86aebb10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.432833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30675d9-c37d-488d-9b6f-5502682f235a None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.436712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.437322 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.437606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.437875 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.446347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.447854 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.451999 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e502a-ebb7-4d06-bd1b-7df86aebb10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.453599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e502a-ebb7-4d06-bd1b-7df86aebb10c service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.456986 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1415/2839] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:59.457623 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:59.465469 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1425/2840] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:54:59.478546 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.489388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc1fe7-cafa-4557-9985-477d2d6249ca service cinder] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.494281 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.495040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.495391 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.495732 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] PATH_INFO: `/v3/users/ac74c3f94bad4e72aad0db5b2537d8db` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.496976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac74c3f94bad4e72aad0db5b2537d8db)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.499773 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.554606 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac74c3f94bad4e72aad0db5b2537d8db'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:59.564088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac74c3f94bad4e72aad0db5b2537d8db'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:59.572219 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac74c3f94bad4e72aad0db5b2537d8db'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:59.572968 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac74c3f94bad4e72aad0db5b2537d8db'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:59.586570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac74c3f94bad4e72aad0db5b2537d8db'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:54:59.593354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1416/2841] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:54:59 2022] DELETE /identity/v3/users/ac74c3f94bad4e72aad0db5b2537d8db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:54:59.598128 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.598412 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.598705 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.623771 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:54:59.625068 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:59.693183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1426/2842] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:54:59.703217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:54:59.704765 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:54:59.741492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:59.774891 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c773473-a625-4dca-b7dd-333a48cb2e5c admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:54:59.780114 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a781737-d45e-4953-803d-86aec498ba24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:54:59.780746 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781737-d45e-4953-803d-86aec498ba24 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:54:59.781024 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781737-d45e-4953-803d-86aec498ba24 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:54:59.781295 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a781737-d45e-4953-803d-86aec498ba24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:54:59.791234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781737-d45e-4953-803d-86aec498ba24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:54:59.792673 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a781737-d45e-4953-803d-86aec498ba24 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:54:59.802120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1417/2843] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:00.094966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.096637 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:00.111153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd398b7-03c5-428c-9238-a3e89a5ecabe None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.116596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.117238 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.117532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.117834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] PATH_INFO: `/v3/projects/7e2c3d86826a4baa97202010f2ee269e` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.119145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2c3d86826a4baa97202010f2ee269e)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.121066 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.168901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2c3d86826a4baa97202010f2ee269e', 'request_id': 'req-ff150ebe-c021-4da5-8712-68de00569d9d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:00.174367 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2c3d86826a4baa97202010f2ee269e', 'request_id': 'req-ff150ebe-c021-4da5-8712-68de00569d9d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:00.181250 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2c3d86826a4baa97202010f2ee269e', 'request_id': 'req-ff150ebe-c021-4da5-8712-68de00569d9d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:00.195901 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] The token cache is being invalidate because project 7e2c3d86826a4baa97202010f2ee269e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:55:00.196190 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:00.196835 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-ff150ebe-c021-4da5-8712-68de00569d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:00.198403 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1427/2844] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:55:00 2022] DELETE /identity/v3/projects/7e2c3d86826a4baa97202010f2ee269e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:00.203321 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.203785 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.203882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.223665 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:00.224866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:00.295498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1418/2845] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:00.358568 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.358828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.359045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.386132 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:00.387391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:00.396672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1428/2846] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:00.401442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.411914 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa5659b-ce9f-4a99-9c74-c9aa007360d2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.417882 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.418492 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.418796 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.419064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.419706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:55:00.420001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.421613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.433653 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1419/2847] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 10:55:00.438074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.447939 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd612445-b6d0-4c0c-bd9f-533dc64fa761 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.453295 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.453888 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.454166 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.454721 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.455370 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.457325 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.490054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1429/2848] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:55:00 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:00.495217 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.505778 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e4724-e9e4-43b5-8f0e-69a788b81321 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.566939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.567537 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.567812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.568081 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.568705 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.570609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.593061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1420/2849] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:55:00 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:00.597776 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.609814 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912169d8-a347-41f6-85ed-a3bb623ba8e4 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.616573 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.617532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.617877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.618143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.619131 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.621711 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.637216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1430/2850] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:00.641389 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.652201 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c8589-9c12-443d-8271-91a23238ea18 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.656997 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a73d5d-779a-4bfc-97ba-29cfe86466d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.657589 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a73d5d-779a-4bfc-97ba-29cfe86466d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.657861 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a73d5d-779a-4bfc-97ba-29cfe86466d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.658132 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a73d5d-779a-4bfc-97ba-29cfe86466d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.658804 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a73d5d-779a-4bfc-97ba-29cfe86466d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.660367 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a73d5d-779a-4bfc-97ba-29cfe86466d8 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.670879 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1421/2851] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:00.675045 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.686077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c2bca-41d9-4099-a6d6-ab3243c027dd admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.691395 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.692065 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.692331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.692596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] PATH_INFO: `/v3/projects/a6184583678048f8b58308612581c86a/users/2c9adfce13444940a8e78ad7dadd0f52/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.707978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6184583678048f8b58308612581c86a, user_id=2c9adfce13444940a8e78ad7dadd0f52, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.710614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.726517 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1431/2852] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:55:00 2022] PUT /identity/v3/projects/a6184583678048f8b58308612581c86a/users/2c9adfce13444940a8e78ad7dadd0f52/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:00.737714 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ee8c5-c3aa-4f15-911c-645355628fa2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.737996 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ee8c5-c3aa-4f15-911c-645355628fa2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.738329 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ee8c5-c3aa-4f15-911c-645355628fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.766602 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-c85ee8c5-c3aa-4f15-911c-645355628fa2 None None] MFA Rules not processed for user `2c9adfce13444940a8e78ad7dadd0f52`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:00.767883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-c85ee8c5-c3aa-4f15-911c-645355628fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:00.793818 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:00.848426 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1422/2853] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:00.859893 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:00.861595 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:00.883010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:00.921398 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84198a8c-6b4e-4a3f-8d3f-6d267e5cdf69 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:00.925292 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b37e24a9e7d74e1ca95f6061beeb9343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:00.925951 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:00.926229 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:00.926497 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:00.935389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:00.936831 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:00.945934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1432/2854] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:02.381993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:02.382543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:02.382543 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:02.407394 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:02.408634 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:02.472168 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1423/2855] 10.222.0.33 () {58 vars in 1016 bytes} [Fri Aug 12 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:02.498919 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:02.500501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:02.577055 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83105f6-6605-4299-9cf7-665f34b16114 service glance] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:02.582927 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12743987-829f-4dbc-8992-8b8a7cf1984a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:02.583558 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743987-829f-4dbc-8992-8b8a7cf1984a service nova] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:02.583828 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743987-829f-4dbc-8992-8b8a7cf1984a service nova] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:02.584094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12743987-829f-4dbc-8992-8b8a7cf1984a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:02.592317 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743987-829f-4dbc-8992-8b8a7cf1984a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:02.593896 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12743987-829f-4dbc-8992-8b8a7cf1984a service nova] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:02.603611 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1433/2856] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:12.464135 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=43 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:12.599187 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=52 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:16.549563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:16.559567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209688a6-2240-46b8-bbaa-7c78a534d9c2 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:16.565440 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:16.566140 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:16.566419 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:16.566711 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] PATH_INFO: `/v3/users/2c9adfce13444940a8e78ad7dadd0f52` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:16.568072 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9adfce13444940a8e78ad7dadd0f52)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:16.569962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:16.622331 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9adfce13444940a8e78ad7dadd0f52'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:16.630555 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9adfce13444940a8e78ad7dadd0f52'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:16.637956 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9adfce13444940a8e78ad7dadd0f52'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:16.638622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9adfce13444940a8e78ad7dadd0f52'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:16.652277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9adfce13444940a8e78ad7dadd0f52'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:16.658247 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1424/2857] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:55:16 2022] DELETE /identity/v3/users/2c9adfce13444940a8e78ad7dadd0f52 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:16.663216 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:16.663704 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:16.663826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:16.685608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:16.687266 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:16.763841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1434/2858] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:16.775253 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:16.776918 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:16.840834 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39e8a8-a462-4357-b336-30431906f4da admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:16.844927 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1da167-17ad-4697-88e4-e9619c0f6e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:16.845396 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1da167-17ad-4697-88e4-e9619c0f6e02 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:16.845681 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1da167-17ad-4697-88e4-e9619c0f6e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:16.845975 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1da167-17ad-4697-88e4-e9619c0f6e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:16.855086 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1da167-17ad-4697-88e4-e9619c0f6e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:16.856526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1da167-17ad-4697-88e4-e9619c0f6e02 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:16.866307 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1425/2859] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:17.145110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.146815 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:17.162308 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa5146-844b-4916-953c-c6a0edaf3e72 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.167433 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.168061 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.168336 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.168607 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] PATH_INFO: `/v3/projects/a6184583678048f8b58308612581c86a` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.169854 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6184583678048f8b58308612581c86a)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.171853 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.226923 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6184583678048f8b58308612581c86a', 'request_id': 'req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:17.233402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6184583678048f8b58308612581c86a', 'request_id': 'req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:17.240582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6184583678048f8b58308612581c86a', 'request_id': 'req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:17.258659 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] The token cache is being invalidate because project a6184583678048f8b58308612581c86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:55:17.259178 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:17.260000 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-bf9881d9-0fc9-4d5f-bc8d-d949a72f1ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:17.261600 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1435/2860] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:55:17 2022] DELETE /identity/v3/projects/a6184583678048f8b58308612581c86a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:17.267215 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.267500 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.267774 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.295205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:17.297580 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:17.366365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1426/2861] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:17.376655 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.377094 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.377520 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.397613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:17.399148 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:17.407151 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1436/2862] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:17.411584 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.421812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932cb3f-fb28-4b9d-9984-6811e875264b None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.426835 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.427428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.427706 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.427976 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.428613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:55:17.428912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.430499 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.442862 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1427/2863] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:55:17.447762 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.460237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617ea71-50dc-44bb-99bf-d20584e939f3 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.465805 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.466402 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.466658 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.466949 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.467580 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.469468 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.499302 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1437/2864] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:55:17 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:17.503427 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.508823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:17.515522 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3a24-ccdf-4a6a-9442-7987e74afd28 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.585863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.586570 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.586724 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.587053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.587670 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.589586 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.612198 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1428/2865] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:55:17 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:17.616627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.626993 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0a498-7fac-4d03-816c-d9b0a87fd0db admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.631864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.632457 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.632728 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.632992 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.633672 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.635268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.645130 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1438/2866] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:17.649428 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.659648 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf2080-5f3e-4da1-828a-a6bd14466a2f admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.664630 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f316e-9d9d-43cf-982f-46f7f58eda53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.665211 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f316e-9d9d-43cf-982f-46f7f58eda53 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.665487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f316e-9d9d-43cf-982f-46f7f58eda53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.665745 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f316e-9d9d-43cf-982f-46f7f58eda53 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.666384 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f316e-9d9d-43cf-982f-46f7f58eda53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.668120 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f316e-9d9d-43cf-982f-46f7f58eda53 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.679945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1429/2867] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:17.686572 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.700077 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29674ef4-52fa-4926-9694-f3af58a7a02d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.707765 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.708405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.708684 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.708953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] PATH_INFO: `/v3/projects/8730d625462e4c98b77bd09beab315fb/users/cf42d097a4d344af8f24f5c5a3c873a5/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.724647 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8730d625462e4c98b77bd09beab315fb, user_id=cf42d097a4d344af8f24f5c5a3c873a5, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.727389 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.744254 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1439/2868] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:55:17 2022] PUT /identity/v3/projects/8730d625462e4c98b77bd09beab315fb/users/cf42d097a4d344af8f24f5c5a3c873a5/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:17.754938 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.755223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.755487 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.783883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] MFA Rules not processed for user `cf42d097a4d344af8f24f5c5a3c873a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:17.785082 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:17.852498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1430/2869] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:17.863940 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:17.865741 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:17.888144 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:17.929792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6f232-ea8e-40bc-b827-b8f4fd33abf7 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:17.933618 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840ee2-e902-4107-8131-efdb95d9fc30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '044f1d33d9be4cdc827237fae316db0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:17.934232 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840ee2-e902-4107-8131-efdb95d9fc30 service cinder] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:17.934480 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840ee2-e902-4107-8131-efdb95d9fc30 service cinder] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:17.934782 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840ee2-e902-4107-8131-efdb95d9fc30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:17.943598 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840ee2-e902-4107-8131-efdb95d9fc30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:17.945110 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840ee2-e902-4107-8131-efdb95d9fc30 service cinder] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:17.954236 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1440/2870] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:17.980258 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:18.047883 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376a6bd-db84-4b51-8d62-31f0c0f38575 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:18.052812 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:18.053442 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:18.053703 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:18.053962 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] PATH_INFO: `/v3/users/cf42d097a4d344af8f24f5c5a3c873a5` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:18.055134 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf42d097a4d344af8f24f5c5a3c873a5)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:18.057053 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:18.069946 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:18.105676 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf42d097a4d344af8f24f5c5a3c873a5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.114361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf42d097a4d344af8f24f5c5a3c873a5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.122413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf42d097a4d344af8f24f5c5a3c873a5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.123077 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf42d097a4d344af8f24f5c5a3c873a5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.135572 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf42d097a4d344af8f24f5c5a3c873a5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.141504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1431/2871] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:55:17 2022] DELETE /identity/v3/users/cf42d097a4d344af8f24f5c5a3c873a5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:18.146217 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:18.146504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:18.146809 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:18.167373 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:18.168602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:18.229524 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1441/2872] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:18.239840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:18.241347 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:18.302018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f46f54-23af-40fd-b339-e081425e6441 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:18.307124 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:18.308612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:18.308896 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:18.309162 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:18.319901 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:18.321526 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:18.332536 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1432/2873] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 10:55:18.865079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:18.866695 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:18.879628 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4390a-5978-48ff-8d86-3d8859b4f190 None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:18.885707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:18.885891 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:18.886108 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:18.886378 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] PATH_INFO: `/v3/projects/8730d625462e4c98b77bd09beab315fb` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:18.887596 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8730d625462e4c98b77bd09beab315fb)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:18.889504 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:18.937192 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8730d625462e4c98b77bd09beab315fb', 'request_id': 'req-2c72b59b-fc9f-4622-a63b-4132a6290083'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.943039 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8730d625462e4c98b77bd09beab315fb', 'request_id': 'req-2c72b59b-fc9f-4622-a63b-4132a6290083'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.949074 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8730d625462e4c98b77bd09beab315fb', 'request_id': 'req-2c72b59b-fc9f-4622-a63b-4132a6290083'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.962707 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] The token cache is being invalidate because project 8730d625462e4c98b77bd09beab315fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:55:18.963006 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.963627 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:18.965436 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1442/2874] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:55:18 2022] DELETE /identity/v3/projects/8730d625462e4c98b77bd09beab315fb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:28.327514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:28.959532 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:31.738838 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:31.740730 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:31.831985 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d53645-7511-4fd6-99f0-2260e6d11d19 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:31.892690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:31.893719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:31.893924 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:31.894221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] PATH_INFO: `/v3/users/75eb365788c1489aa6119a3e21fd1c7d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:31.895825 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75eb365788c1489aa6119a3e21fd1c7d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:31.898646 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:31.955542 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75eb365788c1489aa6119a3e21fd1c7d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:31.964690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75eb365788c1489aa6119a3e21fd1c7d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:31.972549 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75eb365788c1489aa6119a3e21fd1c7d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:31.973310 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75eb365788c1489aa6119a3e21fd1c7d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:31.986575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-0e7ba0bf-c7fa-4696-b023-8e725878b836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75eb365788c1489aa6119a3e21fd1c7d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:31.992817 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1433/2875] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:55:31 2022] DELETE /identity/v3/users/75eb365788c1489aa6119a3e21fd1c7d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:32.198306 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.199908 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:32.261884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72b59b-fc9f-4622-a63b-4132a6290083 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.319424 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.320100 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.320400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.320638 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] PATH_INFO: `/v3/projects/b40be0dd380a43e6b91f15dc1f1ee6d6` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.321834 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40be0dd380a43e6b91f15dc1f1ee6d6)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.323816 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.372393 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40be0dd380a43e6b91f15dc1f1ee6d6', 'request_id': 'req-3f0aea56-db86-4d23-82d1-4888ba40d573'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:32.378018 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40be0dd380a43e6b91f15dc1f1ee6d6', 'request_id': 'req-3f0aea56-db86-4d23-82d1-4888ba40d573'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:32.385059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40be0dd380a43e6b91f15dc1f1ee6d6', 'request_id': 'req-3f0aea56-db86-4d23-82d1-4888ba40d573'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:32.400222 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] The token cache is being invalidate because project b40be0dd380a43e6b91f15dc1f1ee6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:55:32.400506 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:32.401134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-3f0aea56-db86-4d23-82d1-4888ba40d573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:55:32.402708 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1443/2876] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:55:32 2022] DELETE /identity/v3/projects/b40be0dd380a43e6b91f15dc1f1ee6d6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:32.407940 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.408224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.408490 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.433262 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:32.480413 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:32.481563 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:32.544598 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1434/2877] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:32.553823 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.554140 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.554491 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.575231 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:32.576442 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:32.585737 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1444/2878] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:32.590205 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.600712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20caa5c7-1a51-4e58-88c0-a90b46bbe613 None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.606274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.606905 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.607184 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.607456 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.608119 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93274) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 10:55:32.608404 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.610065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.622649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1435/2879] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 10:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 10:55:32.628826 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.642452 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbfbc4a-c56a-46a8-8310-ec5a24e49bdc None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.650990 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.651593 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.651864 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.652127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.652742 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.654650 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.688400 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1445/2880] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:55:32 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:32.692622 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.702381 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffea3c-5d97-464f-91ad-0fe0559e8d58 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.757757 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.758422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.758548 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.758823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.759437 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.761339 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.785840 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1436/2881] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:55:32 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 10:55:32.790054 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.800274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cca556-f66d-489b-bd61-ac63b877e993 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.805150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.805738 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.806010 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.806274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.806943 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.808531 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.818228 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1446/2882] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:32.822395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.832743 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd014-884d-4c97-9dc2-4d4d349ee42d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.838236 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687911c-c215-4f8f-8f7c-d25255f881c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.838993 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687911c-c215-4f8f-8f7c-d25255f881c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.839191 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687911c-c215-4f8f-8f7c-d25255f881c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.839462 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687911c-c215-4f8f-8f7c-d25255f881c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.840152 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687911c-c215-4f8f-8f7c-d25255f881c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.841893 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687911c-c215-4f8f-8f7c-d25255f881c5 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.853544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1437/2883] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:32.858356 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:32.868755 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805c19f-d8eb-4eab-9847-489c52bdfa04 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:32.873899 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:32.874555 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] REQUEST_METHOD: `PUT` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.874870 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.875141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] PATH_INFO: `/v3/projects/fbd26fd37fd34018a0b682486fa9de7f/users/25d507fda4e34b0680f6bf87476fc31d/roles/4dfba98327a94751bce3982770d6465f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.877617 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:32.892877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd26fd37fd34018a0b682486fa9de7f, user_id=25d507fda4e34b0680f6bf87476fc31d, role_id=4dfba98327a94751bce3982770d6465f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:32.895749 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:32.910079 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1447/2884] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:55:32 2022] PUT /identity/v3/projects/fbd26fd37fd34018a0b682486fa9de7f/users/25d507fda4e34b0680f6bf87476fc31d/roles/4dfba98327a94751bce3982770d6465f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:32.915769 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af97d-efa0-4922-a937-ac914e8b8fe7 None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:32.916065 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af97d-efa0-4922-a937-ac914e8b8fe7 None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:32.916342 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50af97d-efa0-4922-a937-ac914e8b8fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:32.935089 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-e50af97d-efa0-4922-a937-ac914e8b8fe7 None None] MFA Rules not processed for user `27ab679ee4a24103a432644a1ffbc5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:32.936297 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e50af97d-efa0-4922-a937-ac914e8b8fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:32.991056 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:33.004133 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1438/2885] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:33.013915 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:33.015630 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:33.094495 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f54b-9756-436e-8986-94099911703b admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:33.101566 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:33.102153 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:33.102448 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:33.102701 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:33.113134 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:33.114585 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:33.124196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1448/2886] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:37.699823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:37.700395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:37.700395 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:37.732544 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] MFA Rules not processed for user `25d507fda4e34b0680f6bf87476fc31d`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:37.734200 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:37.811575 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1439/2887] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:37.815667 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:37.826976 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78b7be-f912-4e7d-8e6a-8045b1fdb168 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:37.832674 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:37.833391 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:37.833803 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:37.834173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] PATH_INFO: `/v3/projects` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:37.835097 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:37.837171 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:37.872064 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1449/2888] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 10:55:37 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:37.873270 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:37.884511 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc23c1-ddbb-4be3-a58e-d9872d9777be None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:37.948414 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:37.949027 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:37.949301 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:37.949578 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] PATH_INFO: `/v3/users` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:37.950222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:37.952228 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:37.975839 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1440/2889] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 10:55:37 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 10:55:37.980081 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:37.994129 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5458f-3d2c-4ba4-b979-b282cc09912f admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:37.999334 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:37.999920 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:38.000196 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:38.000465 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:38.001259 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:38.002725 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:38.013860 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1450/2890] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:38.018221 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:38.029784 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4188562-90aa-4244-9063-992f24ee186d admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:38.034588 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:38.035277 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:38.035561 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:38.035831 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] PATH_INFO: `/v3/projects/83057bc67de84985a95c149cc4c8666e/users/684256e0e23049b18e99265852700f93/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:38.054061 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83057bc67de84985a95c149cc4c8666e, user_id=684256e0e23049b18e99265852700f93, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:38.056852 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:38.074731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1441/2891] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:55:38 2022] PUT /identity/v3/projects/83057bc67de84985a95c149cc4c8666e/users/684256e0e23049b18e99265852700f93/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:55:38.077651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:38.090651 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb460a-b265-4f4e-9531-b26992ee97dd admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:38.158713 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7b1f5-c5eb-44ea-a66e-7bc08a1fa2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:38.159426 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b1f5-c5eb-44ea-a66e-7bc08a1fa2ab admin admin] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:38.159795 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b1f5-c5eb-44ea-a66e-7bc08a1fa2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:38.160155 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7b1f5-c5eb-44ea-a66e-7bc08a1fa2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:38.160902 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7b1f5-c5eb-44ea-a66e-7bc08a1fa2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:38.162606 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7b1f5-c5eb-44ea-a66e-7bc08a1fa2ab admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:38.173472 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1451/2892] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 10:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 10:55:38.177649 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:38.188088 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f0f58-d912-433d-8740-cc0d231c9f20 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:38.192779 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:38.193498 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] REQUEST_METHOD: `PUT` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:38.193846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:38.194232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] PATH_INFO: `/v3/projects/83057bc67de84985a95c149cc4c8666e/users/684256e0e23049b18e99265852700f93/roles/4f487b987d3d44cf853d679f27cf2032` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:38.196380 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=83057bc67de84985a95c149cc4c8666e, user_id=684256e0e23049b18e99265852700f93, role_id=4f487b987d3d44cf853d679f27cf2032)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:38.199174 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:38.211469 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1442/2893] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 10:55:38 2022] PUT /identity/v3/projects/83057bc67de84985a95c149cc4c8666e/users/684256e0e23049b18e99265852700f93/roles/4f487b987d3d44cf853d679f27cf2032 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 10:55:43.059894 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0cfa-5716-4310-a35a-6b703374724e None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:43.060709 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0cfa-5716-4310-a35a-6b703374724e None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:43.060995 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a0cfa-5716-4310-a35a-6b703374724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:43.090408 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-b25a0cfa-5716-4310-a35a-6b703374724e None None] MFA Rules not processed for user `684256e0e23049b18e99265852700f93`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:43.091690 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-b25a0cfa-5716-4310-a35a-6b703374724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:43.112839 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:43.166903 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1452/2894] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:43.181984 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:43.183846 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:43.225432 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:43.295886 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6d4d-fb35-4bbe-a915-9ecf6fcb7dba admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:43.303223 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:43.303863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:43.304142 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:43.304411 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:43.362917 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:43.365719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:43.378865 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1443/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:55:44.413235 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] REQUEST_METHOD: `POST` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:44.414145 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:44.414449 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:44.435115 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.auth.core [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] MFA Rules not processed for user `25d507fda4e34b0680f6bf87476fc31d`. Rule list: `[]` (Enabled: `True`). {{(pid=93275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:55:44.436613 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:44.444299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1453/2896] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 10:55:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:55:53.372738 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=52 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:54.429247 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=22 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:57.874388 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:55:57.876076 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:57.975731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69505494-908d-444c-afab-186ec0dcc5b7 service nova] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:55:57.981613 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:55:57.982224 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:55:57.982495 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:55:57.982897 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:55:57.984748 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:55:57.997013 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:55:57.998709 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbcf7c-adc3-46b2-9cd7-b8d86bc4c09d service placement] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:55:58.008534 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1444/2897] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:55:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:56:07.015083 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:56:07.085934 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab5d20-e3e4-4261-873b-4e8251d2f1aa None None] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:56:07.090165 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:56:07.090792 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:07.091119 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:07.091405 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:07.100822 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:56:07.102257 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:56:07.111772 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1454/2898] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:56:08.004337 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=41 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:17.107840 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=30 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:29.048999 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] REQUEST_METHOD: `POST` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:29.049486 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:29.049644 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:29.083001 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.auth.core [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] MFA Rules not processed for user `ee81f1a2fd8a4d0d9c6b1ae1dc418e44`. Rule list: `[]` (Enabled: `True`). {{(pid=93274) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 10:56:29.084232 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:56:29.146046 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1445/2899] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 10:56:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 10:56:29.186601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:56:29.188135 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:56:29.263877 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a908c92-f6bc-4ffb-aaf2-3d3625f29395 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:56:29.270339 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92705446-8195-494b-977b-7ba173a70674 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4434ebd2f9c42abaf5f1191681c9989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:56:29.270978 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92705446-8195-494b-977b-7ba173a70674 service swift] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:29.271253 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92705446-8195-494b-977b-7ba173a70674 service swift] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:29.271535 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92705446-8195-494b-977b-7ba173a70674 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:29.280614 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92705446-8195-494b-977b-7ba173a70674 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:56:29.282287 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92705446-8195-494b-977b-7ba173a70674 service swift] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:56:29.290539 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1455/2900] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 10:56:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 10:56:35.932194 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:56:35.934149 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:56:36.009551 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee61bc-7e7f-458c-82da-58ad2ecfbcaa None None] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:56:36.014963 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:56:36.015800 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:36.016161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:36.016373 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] PATH_INFO: `/v3/users/507f5b173f924cb89d001a317c0ce0c5` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:36.017655 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=507f5b173f924cb89d001a317c0ce0c5)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:56:36.020229 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:56:36.069122 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507f5b173f924cb89d001a317c0ce0c5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.077912 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507f5b173f924cb89d001a317c0ce0c5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.086532 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507f5b173f924cb89d001a317c0ce0c5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.087358 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507f5b173f924cb89d001a317c0ce0c5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.099829 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507f5b173f924cb89d001a317c0ce0c5'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.105945 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1446/2901] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:56:35 2022] DELETE /identity/v3/users/507f5b173f924cb89d001a317c0ce0c5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:56:36.282049 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92705446-8195-494b-977b-7ba173a70674 service swift] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:56:36.297691 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92705446-8195-494b-977b-7ba173a70674 service swift] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:56:36.354113 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:56:36.354779 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:36.355059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:36.355818 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] PATH_INFO: `/v3/projects/4110d845a76a421aa2173093f88ac5d8` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:36.356601 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4110d845a76a421aa2173093f88ac5d8)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:56:36.358697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:56:36.416533 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4110d845a76a421aa2173093f88ac5d8', 'request_id': 'req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.422662 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4110d845a76a421aa2173093f88ac5d8', 'request_id': 'req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.429060 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4110d845a76a421aa2173093f88ac5d8', 'request_id': 'req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.447685 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] The token cache is being invalidate because project 4110d845a76a421aa2173093f88ac5d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:56:36.448003 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.448624 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.450174 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1456/2902] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:56:36 2022] DELETE /identity/v3/projects/4110d845a76a421aa2173093f88ac5d8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:56:36.454422 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:56:36.455939 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:56:36.468994 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e002-a4fb-4390-93ed-815a2554c4aa admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:56:36.481514 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:36.528069 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:56:36.528626 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:36.528907 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:36.529179 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] PATH_INFO: `/v3/users/9dfad83c34fe4574b131adfe1b6a2234` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:36.530365 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dfad83c34fe4574b131adfe1b6a2234)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:56:36.532352 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:56:36.581529 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dfad83c34fe4574b131adfe1b6a2234'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.592712 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dfad83c34fe4574b131adfe1b6a2234'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.600288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dfad83c34fe4574b131adfe1b6a2234'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.601010 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dfad83c34fe4574b131adfe1b6a2234'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.613102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dfad83c34fe4574b131adfe1b6a2234'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.619965 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1447/2903] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:56:36 2022] DELETE /identity/v3/users/9dfad83c34fe4574b131adfe1b6a2234 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:56:36.795185 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:56:36.796669 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:56:36.810425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a703c-8d7e-4fc8-b65b-74edcb526ddd admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:56:36.828966 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:36.869733 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:56:36.870363 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:56:36.870636 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:56:36.870936 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] PATH_INFO: `/v3/projects/c055e95469224926af24397b1134942b` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:56:36.872173 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c055e95469224926af24397b1134942b)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:56:36.874102 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:56:36.924807 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c055e95469224926af24397b1134942b', 'request_id': 'req-a1e74dd4-6561-4604-8e88-256ec419be14'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.930937 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c055e95469224926af24397b1134942b', 'request_id': 'req-a1e74dd4-6561-4604-8e88-256ec419be14'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.937087 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c055e95469224926af24397b1134942b', 'request_id': 'req-a1e74dd4-6561-4604-8e88-256ec419be14'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.950404 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] The token cache is being invalidate because project c055e95469224926af24397b1134942b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:56:36.950700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.951347 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:56:36.952874 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1457/2904] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:56:36 2022] DELETE /identity/v3/projects/c055e95469224926af24397b1134942b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:56:46.616148 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:46.947660 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:06.287631 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:06.289294 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:06.361863 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e67c2-3acd-467c-b75f-68addcb2db57 admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:06.417874 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:06.418517 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:06.418823 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:06.419093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:06.420948 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:06.498633 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:06.500130 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:06.511222 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1448/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:58:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:58:07.709735 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:07.711501 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:07.725170 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e74dd4-6561-4604-8e88-256ec419be14 admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:07.729991 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:07.730590 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:07.730897 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:07.731160 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:07.733213 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:07.747411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:07.748841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:07.759810 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1458/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:58:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:58:16.506213 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=79 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:16.508966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:16.518567 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4da5-0cb4-44cd-87fd-944a718e6078 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:16.523129 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:16.523733 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:16.524009 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:16.524274 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:16.526783 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:16.537521 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:16.538981 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:16.547455 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1449/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:58:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:58:17.755274 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=6 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:19.960399 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:19.969774 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4efb5-e298-4486-95ba-8ed1be0858e3 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:19.973953 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:19.974567 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:19.974880 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:19.975143 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:19.976890 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:19.990301 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:19.991759 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:20.000500 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1459/2908] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:58:20.097259 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:20.106866 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7da9c-af2f-4548-a1fd-630930cc4bcc service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:20.111123 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afcf59c6d1954210abe8421b9a5b49ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:20.111808 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:20.112216 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:20.112604 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:20.114661 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:20.133379 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:20.135018 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:20.145833 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1450/2909] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:58:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:58:20.209700 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:58:20.212141 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:20.294314 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cb3b2-0d84-4a0a-8b8a-d11264826e43 service neutron] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:58:20.299714 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:58:20.300331 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:58:20.300602 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:58:20.300861 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:58:20.302783 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:58:20.314345 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:58:20.315982 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:58:20.325957 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1460/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:58:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:58:30.141208 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=12 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.321956 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=38 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:40.378842 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:40.380354 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:40.401814 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040f39-85c0-4cd2-be37-96ebaee21f22 service neutron] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:40.409282 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e37ccc38bfcb43288a9f451428d293e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:40.409971 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:40.410315 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:40.410744 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:40.412571 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:40.427335 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:40.429657 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:40.453826 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1451/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:59:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:59:47.308243 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:47.309731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:47.323005 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eb74e-c645-4202-a44e-062c4e3c720c service placement] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:47.328548 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:47.329150 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] REQUEST_METHOD: `GET` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:47.329425 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:47.329694 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:47.331608 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:47.344657 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:47.346248 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:47.358059 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1461/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 10:59:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 10:59:50.281273 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.282849 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:50.349690 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f187a3-8894-4e3b-9f2d-9a100893adc5 service nova] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.355093 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.355719 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.355989 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.356252 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] PATH_INFO: `/v3/users/25d507fda4e34b0680f6bf87476fc31d` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.357504 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d507fda4e34b0680f6bf87476fc31d)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.359473 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.419412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d507fda4e34b0680f6bf87476fc31d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.428643 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d507fda4e34b0680f6bf87476fc31d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.436064 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d507fda4e34b0680f6bf87476fc31d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.436723 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d507fda4e34b0680f6bf87476fc31d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.449161 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d507fda4e34b0680f6bf87476fc31d'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.455288 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1452/2913] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:59:50 2022] DELETE /identity/v3/users/25d507fda4e34b0680f6bf87476fc31d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:50.631014 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.646841 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9dee-5bf5-4fa3-8a3c-ee21ea9fab26 service placement] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.704299 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.704907 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.705188 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.705459 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] PATH_INFO: `/v3/projects/fbd26fd37fd34018a0b682486fa9de7f` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.706599 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd26fd37fd34018a0b682486fa9de7f)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.708537 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.756183 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd26fd37fd34018a0b682486fa9de7f', 'request_id': 'req-71964513-6c1c-45dd-adf3-eb6434b9197d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.761729 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd26fd37fd34018a0b682486fa9de7f', 'request_id': 'req-71964513-6c1c-45dd-adf3-eb6434b9197d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.772237 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd26fd37fd34018a0b682486fa9de7f', 'request_id': 'req-71964513-6c1c-45dd-adf3-eb6434b9197d'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.791362 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] The token cache is being invalidate because project fbd26fd37fd34018a0b682486fa9de7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:59:50.791731 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.792799 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.795275 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1462/2914] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:59:50 2022] DELETE /identity/v3/projects/fbd26fd37fd34018a0b682486fa9de7f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:50.799564 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:50.801040 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:50.816667 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efd334-7632-4eb1-9faa-745fd30faded admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:50.884868 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:50.885412 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:50.885693 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:50.885966 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] PATH_INFO: `/v3/users/684256e0e23049b18e99265852700f93` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:50.887165 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=684256e0e23049b18e99265852700f93)` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:50.889102 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:50.894688 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:50.935890 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684256e0e23049b18e99265852700f93'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.944234 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684256e0e23049b18e99265852700f93'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.951112 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684256e0e23049b18e99265852700f93'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.951735 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684256e0e23049b18e99265852700f93'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.963627 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.notifications [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684256e0e23049b18e99265852700f93'} {{(pid=93274) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:50.969466 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1453/2915] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 10:59:50 2022] DELETE /identity/v3/users/684256e0e23049b18e99265852700f93 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 10:59:51.162127 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Authenticating user token {{(pid=93275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 10:59:51.163743 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.fernet_utils [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 10:59:51.179697 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964513-6c1c-45dd-adf3-eb6434b9197d admin admin] Validating token access rules against request {{(pid=93275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 10:59:51.243913 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27ab679ee4a24103a432644a1ffbc5b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3424e260c7f45ca91161a9eb3a1a521', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 10:59:51.244565 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 10:59:51.244838 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] SCRIPT_NAME: `/identity` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 10:59:51.245107 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] PATH_INFO: `/v3/projects/83057bc67de84985a95c149cc4c8666e` {{(pid=93275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 10:59:51.246268 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83057bc67de84985a95c149cc4c8666e)` {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 10:59:51.248177 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] RBAC: Authorization granted {{(pid=93275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 10:59:51.268582 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:51.296884 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83057bc67de84985a95c149cc4c8666e', 'request_id': 'req-67e6a8d5-a6be-4ccd-808a-69deabd0761b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:51.302382 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83057bc67de84985a95c149cc4c8666e', 'request_id': 'req-67e6a8d5-a6be-4ccd-808a-69deabd0761b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:51.308485 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83057bc67de84985a95c149cc4c8666e', 'request_id': 'req-67e6a8d5-a6be-4ccd-808a-69deabd0761b'} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:51.322341 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] The token cache is being invalidate because project 83057bc67de84985a95c149cc4c8666e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 10:59:51.322748 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:51.323411 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG keystone.notifications [None req-67e6a8d5-a6be-4ccd-808a-69deabd0761b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 10:59:51.324909 dv-cinder-852945-1-smb devstack@keystone.service[93275]: [pid: 93275|app: 0|req: 1463/2916] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 10:59:51 2022] DELETE /identity/v3/projects/83057bc67de84985a95c149cc4c8666e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 11:00:00.966078 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:01.319477 dv-cinder-852945-1-smb devstack@keystone.service[93275]: DEBUG dbcounter [-] [93275] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:41.560225 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Authenticating user token {{(pid=93274) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 11:01:41.565591 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:41.657151 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870a3d4-afff-47b2-8be8-481c71e3f5af admin admin] Validating token access rules against request {{(pid=93274) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 11:01:41.722439 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '773a76b9319a4e18b1bcff3cb85d0a64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '645bc74c5a1e42a6a58067b78bd0c1cc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93274) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 11:01:41.723083 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] REQUEST_METHOD: `GET` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 11:01:41.723361 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] SCRIPT_NAME: `/identity` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 11:01:41.723637 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93274) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 11:01:41.725731 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.fernet_utils [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93274) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 11:01:41.737951 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 11:01:41.739612 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a281bef-f320-401e-ad0e-117ee3402515 service placement] RBAC: Authorization granted {{(pid=93274) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 11:01:41.749677 dv-cinder-852945-1-smb devstack@keystone.service[93274]: [pid: 93274|app: 0|req: 1454/2917] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 11:01:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 11:01:51.745609 dv-cinder-852945-1-smb devstack@keystone.service[93274]: DEBUG dbcounter [-] [93274] Writing DB stats keystone:SELECT=58 {{(pid=93274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}